-- Logs begin at Wed 2020-12-02 14:48:35 UTC, end at Wed 2020-12-02 16:06:44 UTC. -- Dec 02 15:38:17.575868 dv-cinder-737618-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 02 15:38:17.584326 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Dec 2 15:38:17 2020] *** Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: nodename: dv-cinder-737618-2-iscsi Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: machine: x86_64 Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: clock source: unix Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: pcre jit disabled Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: detected number of CPU cores: 4 Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: current working directory: / Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: detected binary path: /usr/bin/uwsgi-core Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: dropping root privileges as early as possible Dec 02 15:38:17.586583 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: your processes number limit is 47843 Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: your memory page size is 4096 bytes Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: detected max file descriptor number: 2048 Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: lock engine: pthread robust mutexes Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: thunder lock: enabled Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: dropping root privileges after socket binding Dec 02 15:38:17.587572 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 02 15:38:17.632182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: Python main interpreter initialized at 0x5611384dc9c0 Dec 02 15:38:17.632182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: dropping root privileges after plugin initialization Dec 02 15:38:17.632182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: python threads support enabled Dec 02 15:38:17.632182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: your server socket listen backlog is limited to 100 connections Dec 02 15:38:17.632182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: your mercy for graceful operations on workers is 90 seconds Dec 02 15:38:17.632664 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: mapped 402621 bytes (393 KB) for 2 cores Dec 02 15:38:17.632664 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: *** Operational MODE: preforking *** Dec 02 15:38:17.632862 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: dropping root privileges after application loading Dec 02 15:38:17.632862 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: *** uWSGI is running in multiple interpreter mode *** Dec 02 15:38:17.632862 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: spawned uWSGI master process (pid: 79711) Dec 02 15:38:17.633789 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: spawned uWSGI worker 1 (pid: 79712, cores: 1) Dec 02 15:38:17.633789 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: spawned uWSGI worker 2 (pid: 79713, cores: 1) Dec 02 15:38:17.633789 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 02 15:38:17.632932 dv-cinder-737618-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 02 15:38:22.102984 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 02 15:38:22.103505 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 02 15:38:22.104874 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 02 15:38:22.105312 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 02 15:38:22.105605 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 02 15:38:22.106067 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.106436 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.106799 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.107174 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.107532 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.107888 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.108285 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.108638 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.109571 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.109975 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.110432 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.110729 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.111094 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.111466 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-2-iscsi {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.111833 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.112211 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.112565 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.112928 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.113279 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.113647 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.114015 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.114607 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.114954 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.115297 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.115646 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.116054 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 02 15:38:22.116138 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.116365 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 02 15:38:22.116466 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.116702 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.117067 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.117415 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.117785 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.117890 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 02 15:38:22.118134 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.118303 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 02 15:38:22.118505 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-2-iscsi {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.118605 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 02 15:38:22.118861 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.119030 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.119212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.119398 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.119564 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.119761 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.120080 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.120191 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.120432 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.120530 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.120780 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.120878 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.121141 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.121238 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.121506 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.121604 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.121852 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.121955 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.122213 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.122316 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.122571 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.122680 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.122858 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.122956 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.123220 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.123330 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.123585 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.123688 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-2-iscsi {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.123930 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.124057 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.124333 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.124549 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.125301 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.125455 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.125647 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.125993 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.126157 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.126274 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.126510 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.126770 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.126874 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.127225 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.127340 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.127818 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.127924 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.128203 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.128384 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.128559 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.128808 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.128917 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.129207 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.129308 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.129599 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.129699 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.129951 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.130184 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.130291 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.130641 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.130750 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.131013 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.131200 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.131466 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.131763 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-2-iscsi {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.131862 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.132155 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.132316 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.132510 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.132804 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.132902 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.133260 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.133361 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.133664 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.133775 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.134017 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.134222 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.134384 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.134752 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.134850 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.135100 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.135200 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.135470 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.135705 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.135828 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.136212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.136324 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.136576 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.136749 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.136921 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.137273 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.137371 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.101 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.137614 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.137750 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.101 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.137961 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.138223 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.138333 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.138628 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.138727 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.138916 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.139212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.139311 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.139601 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.139707 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.139967 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.140189 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.140701 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.140961 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.141214 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.141313 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.141531 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.141774 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.141909 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.142248 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.142347 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.142621 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.142721 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.142975 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.143215 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.143321 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.143667 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.143768 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.144085 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.144300 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.144407 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.144617 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.144760 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.145104 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.145202 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.145465 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.145582 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.145834 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.146076 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.146180 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.146519 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.146626 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.146887 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.147045 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.147344 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.101 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.147597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.147706 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.101 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.147952 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.148119 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.148377 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.148586 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.148795 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.149069 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.149173 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.149487 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.149594 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.149857 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.149957 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.150207 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.150425 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.150523 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.150868 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.150974 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.151228 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.151338 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.151594 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.151783 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.151940 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.152254 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.152425 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.152597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.152821 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.152918 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.153278 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.153378 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.153619 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.153720 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.153967 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.154198 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.154295 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.154629 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.154736 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.154976 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.155199 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.155297 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.155640 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.155742 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.156274 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.156548 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.156746 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.156848 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.157191 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.157296 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.157542 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.157765 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.157862 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.158212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.158313 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.158578 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.158685 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.158951 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.159101 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.159299 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.159613 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.159732 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.160079 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.160183 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.160432 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.160542 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.160799 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.161037 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.161141 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.161466 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.161566 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.161836 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.161935 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.162181 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.162369 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.162524 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.162846 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.162945 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.163206 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.163307 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.163551 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.163740 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.163912 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.164241 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.164350 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.164598 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.164698 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.164964 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.165180 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.165280 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.165649 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.165755 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.165998 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.166225 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.166344 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.166683 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.166787 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.167027 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.167191 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.167370 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.167712 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.167820 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.168075 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.168283 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.168443 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.168796 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.168899 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.169140 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.169327 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.169489 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.169833 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.169930 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.170202 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:38:22.170310 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.170597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.170812 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.170975 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.171329 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.171967 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.172403 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.172769 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.172874 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.173160 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.173261 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.173544 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.173771 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.173908 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.174249 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.174353 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.174599 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.174707 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.174972 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.175196 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.175334 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.175649 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.175753 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.176031 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.176415 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.176599 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.176784 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.176950 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.177162 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.177473 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.177604 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.177835 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.178116 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.178221 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.178522 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.178623 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.178882 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.179053 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.179260 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.179542 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.179641 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.179945 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.180097 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.180404 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.180514 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.180795 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.180985 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.181150 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.181499 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.181596 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.181848 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.182028 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.182217 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.182508 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.182660 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.183012 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.183117 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.183361 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.183459 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.183717 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.184020 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.184133 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.184481 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.184586 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.184841 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.184946 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.185198 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.185448 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.185552 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.185864 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.185961 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.186209 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.186410 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.186532 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.186877 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.186983 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.188096 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.188314 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.188597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.188741 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.189072 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.189171 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.189458 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.189567 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.189809 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.189994 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.190169 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.190472 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.190577 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.190845 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.190946 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.191200 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.191408 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.191551 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.191898 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.192016 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.192305 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.192405 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.192659 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.192904 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.193009 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.193348 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.193452 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.193694 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.193792 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.194042 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.194284 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.194383 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.194724 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.194830 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.195161 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.195283 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.195456 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.195706 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.195814 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.196181 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.196285 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.196536 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.196710 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.196917 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.197215 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.197318 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.197616 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.197720 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.197988 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.198271 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.198369 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.198690 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.198794 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.199035 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.199215 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.199385 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.199724 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.199828 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.200095 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.200283 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.200443 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.200828 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.200934 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.201210 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.201315 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.201560 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.201766 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.201905 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.202252 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.202356 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.202601 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.202768 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.203188 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.203455 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.203723 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.204021 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.204142 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.204331 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.204436 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.204718 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.204825 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.205097 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.205212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.205445 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.205543 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.205796 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.205896 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.206156 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.206262 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.206511 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.206609 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.206863 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.206961 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.207212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.207316 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.207559 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.207658 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.207912 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.208050 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.208298 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.208407 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.208647 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.208741 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.208992 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.209092 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.209333 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.209433 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.209675 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.209779 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.210032 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.210131 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.210381 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.210480 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.210997 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.211104 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.211327 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.211426 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.211673 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.211775 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.212072 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.212174 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.212455 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.212638 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.212812 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.212912 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.213167 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.213274 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.213523 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.213633 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.213866 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.213965 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.214207 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.214312 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.214554 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.214665 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.214901 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.215001 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.215247 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.215347 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.215593 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.215703 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.215933 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.216061 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.216298 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.216426 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.216645 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.216744 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.216993 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.217092 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.217343 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.217448 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.217687 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.217786 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.218039 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.218144 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.218557 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.218663 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.219032 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.219363 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.219462 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.219718 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.219817 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.220091 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.220206 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.220440 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.220540 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.220788 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.220887 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.221135 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.221241 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.221485 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.221603 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.221825 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.221923 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.222168 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.222267 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.222611 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.222738 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.222962 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.223061 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.223305 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.223415 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.223692 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.223824 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.224023 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.224141 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.224366 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.224467 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.224718 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.224824 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.225064 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.225165 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.225413 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.225518 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.225770 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.225918 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.226116 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.226217 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.226462 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.226561 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.226810 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.226919 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.227156 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.227416 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.227519 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.227619 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.227821 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.227922 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.228192 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.228349 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.228541 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.228640 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.228898 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.228998 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.229237 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.229344 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.229596 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.229695 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.229960 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.230072 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.230310 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.230420 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.230665 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.231004 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.231103 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.231347 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.231453 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.231711 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.231810 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.232099 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.232212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.232444 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.232551 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.232794 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.232893 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.233146 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.233252 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.233498 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.233608 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.233850 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.234474 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.234735 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.235206 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.235317 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.235558 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.235663 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.235904 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.236073 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.236282 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.236458 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.236635 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.236736 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.236992 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.237091 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.237339 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.237676 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.237781 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.238025 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.238123 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.238375 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.238474 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.238725 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.238824 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.239072 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.239170 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.239421 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.239529 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.239781 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.239881 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.240162 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.240263 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.240510 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.240610 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.240857 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.240962 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.241208 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.241312 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.241554 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.241664 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.241898 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.241997 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.242244 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.242384 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.242574 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.242681 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.242920 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.243025 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.243263 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.243362 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.243613 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.243721 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.243956 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.244074 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.244330 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.244445 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.244688 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.244858 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.245009 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.245108 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.245363 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.245468 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.245705 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.245805 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.246047 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.246152 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.246389 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.246488 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.246733 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.246833 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.247080 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.247179 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.247427 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.247537 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.247770 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.247870 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.248139 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.248241 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.248512 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.248630 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.248820 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.248922 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.249167 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.249266 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.250131 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.250263 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.250798 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.251004 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.251156 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.251361 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.251506 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.251715 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.251883 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.252111 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.252272 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.252469 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.252620 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.252819 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.252972 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.253194 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.253293 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.253550 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.253649 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.253899 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.253999 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.254252 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.254352 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.254599 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.254698 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.254938 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.255038 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.255281 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.255380 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.255619 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.255725 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.255995 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.256098 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.256346 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.256445 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.256686 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.256795 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.257031 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.257136 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.257371 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.257470 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.257713 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.257820 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.258058 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.258163 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.258403 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.258503 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.258751 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.258885 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.259089 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.259189 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.259430 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.259529 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.259770 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.259880 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.260131 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.260232 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.260483 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.260581 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.260829 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.260929 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.261177 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.261275 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.261513 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.261618 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.261865 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.261964 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.262211 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.262308 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.262555 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.262660 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.262898 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.262998 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.263246 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.263345 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.263588 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.263688 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.263930 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.264092 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.264298 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.264397 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.264642 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.264740 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.265006 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.265106 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.265429 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.265783 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.265900 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.266122 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.266223 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.266467 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.266566 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.266812 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.266916 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.267202 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.267302 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.267549 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.267647 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.267919 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.268036 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.268312 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.268412 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.268670 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.268833 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.269015 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.269117 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.269369 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.269469 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.269709 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.269816 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.270064 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.270164 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.270419 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.270524 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.270774 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.270880 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.271120 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.271226 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.271462 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.271561 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.271808 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.271907 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.272182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.272291 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.272529 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.272628 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.272880 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.272980 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.273233 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.273340 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.273584 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.273683 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.273921 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.274027 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.274274 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.274385 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.274617 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.274716 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.274957 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.275056 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.275301 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.275401 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.275643 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.275747 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.276046 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.276151 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.276379 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.276479 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.276733 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.276875 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.277086 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.277234 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.277438 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.277588 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.277785 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.277936 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.278136 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.278291 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.278490 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.278646 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.278840 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.279006 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.279213 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.279364 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.279566 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.279712 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.279911 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.280222 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.280323 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.280595 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.280695 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.281481 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.281829 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.281983 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.282323 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.282439 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.282677 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.282777 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.283022 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.283121 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.283361 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.283470 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.283712 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.283811 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.284081 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.284183 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.284436 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.284546 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.284785 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.284884 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.285129 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.285228 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.285471 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.285577 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.285839 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.285950 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.286260 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.286365 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.286617 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.286717 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.286963 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.287062 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.287306 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.287504 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.287657 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.287861 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.288051 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.288244 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.288397 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.288617 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.288728 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.288987 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.289087 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.289360 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.289468 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.289707 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.289807 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.290065 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.290168 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.290409 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.290514 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.290761 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.290863 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.291132 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.291237 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.291508 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.291607 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.291863 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.291962 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.292249 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.292350 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.292596 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.292695 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.292967 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.293073 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.293330 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.293428 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.293721 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.293819 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.294077 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.294176 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.294431 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.294531 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.294783 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.294888 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.295153 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.295253 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.295525 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.295629 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.295880 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.296016 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.296263 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.296362 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.297212 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.297597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.297697 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.297970 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.298070 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.298327 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.298426 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.298694 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.298793 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.299390 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.299500 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.299595 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.299695 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.299795 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.299896 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.300132 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.300234 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.300490 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.300596 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.300842 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.300948 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.301189 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.301289 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.301534 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.301632 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.301877 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.301983 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.302225 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.302324 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.302563 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.302662 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.302927 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.303033 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.303265 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.303371 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.303620 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.303718 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.303960 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.304115 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.304330 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.304438 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.304964 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305081 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305081 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305274 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305368 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305461 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305697 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.305796 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.306059 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.306166 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.306407 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.306507 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.306768 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.306867 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.307131 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.307230 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.307478 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.307577 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.307827 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.307926 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.308197 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.308308 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.308607 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.308758 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.308889 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.309000 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.309236 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.309390 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.309610 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.309710 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.309948 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.310054 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.310286 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.310390 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.310638 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.310743 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.310987 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.311120 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.311331 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.311442 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.311682 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.311782 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.312088 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.312194 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.312451 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.312814 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.312914 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.313167 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.313266 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.313508 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.313615 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.313856 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.313963 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.314209 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.314308 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.314557 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.314663 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.314904 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.315010 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.315242 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.315341 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.315584 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.315689 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.315922 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.316067 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.316294 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.316402 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.316637 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.316738 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.317009 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.317113 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.317355 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.317455 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.317716 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.317816 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.318061 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.318160 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.318407 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.318518 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.318752 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.318851 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.319097 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.319196 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.319448 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.319555 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.319809 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.319910 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.320196 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.320308 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.320573 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.320681 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.320940 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.321046 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.321293 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.321392 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.321638 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.321750 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.321988 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.322093 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.322341 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.322439 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.322693 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.322793 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.323042 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.323304 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.323404 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.323687 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.323794 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.324079 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.324182 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.324437 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.324546 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.324786 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.324946 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.325136 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.325245 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.325484 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.325591 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.325843 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.325952 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.326251 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.326442 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.326610 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.326818 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.326965 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.327197 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.327296 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.327550 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.327707 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.327929 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.328316 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.328615 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.328723 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.328993 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.329093 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.329350 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.329457 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.329700 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.329845 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.330049 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.330149 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.330398 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.330497 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.330757 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.330864 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.331117 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.331217 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.331538 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.331638 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.331889 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.332009 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.332281 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.332392 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.332636 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.332737 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.332990 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.333091 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.333345 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.333512 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.333709 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.333810 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.334069 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.334168 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.334406 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.334520 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.334766 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.334865 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.335118 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.335224 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.335474 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.335573 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.336116 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.336224 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.336471 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.336579 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.336826 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.336927 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.337188 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.337287 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.337539 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.337638 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.337881 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.337982 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.338237 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.338380 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.338591 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.338827 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.338965 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.339186 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.339354 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.339566 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.339708 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.339940 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.340107 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.340340 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.340440 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.340700 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.340799 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.341060 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.341284 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.341385 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.341641 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.341746 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.342019 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.342125 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.342389 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.342488 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.342741 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.342840 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.343093 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.343199 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.344015 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.344371 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.344518 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.344721 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.344832 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.345069 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.345175 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.345424 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.345525 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.345774 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.345886 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.346113 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.346401 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.346502 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.346790 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.346888 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.347135 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.347235 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.347498 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.347607 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.347847 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.347947 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.348261 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.348491 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.348591 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.348905 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.349004 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.349278 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.349377 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.349659 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.349784 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.350013 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.350113 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.350367 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.350468 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.350708 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.350807 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.351057 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.351157 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.351399 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.351507 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.351742 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.351842 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.352117 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.352225 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.352465 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.352566 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.352802 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.352902 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.353185 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.353298 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.353493 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.353600 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.353832 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.353931 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.354169 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.354279 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.354518 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.354617 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.354860 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.354959 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.355232 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.355339 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.355573 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.355679 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.355914 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.356038 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.356287 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.356393 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.356628 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.356728 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.356966 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.357071 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.357303 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.357410 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.357642 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.357741 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.357983 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.358088 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.358329 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.358435 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.358669 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.358775 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.359593 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.360000 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.360141 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.360435 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.360536 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.360785 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.360884 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.361147 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.361253 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.361495 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.361594 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.361867 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.361973 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.362207 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.362313 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.362560 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.362675 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.362912 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.363024 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.363265 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.363375 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.363636 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.363864 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.363964 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.364278 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.364390 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.364646 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.364745 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.365042 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.365141 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.365426 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.365646 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.365745 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.366029 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.366128 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.366392 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.366490 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.366779 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.366878 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.367134 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.367233 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.367481 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.367581 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.367828 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.367928 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.368195 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.368295 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.368540 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.368738 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.368886 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.368987 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.369264 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.369377 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.369581 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.369694 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.369933 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.370080 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.370283 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.370384 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.370631 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.370739 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.370982 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.371088 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.371333 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.371433 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.371686 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.371798 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.372064 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.372169 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.372419 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.372520 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.372769 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.372870 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.373121 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.373220 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.373463 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.373569 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.373814 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.373939 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.374165 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.374265 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.374539 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.374643 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.374899 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.375347 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.375428 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.375713 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.375908 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.376117 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.376299 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.376475 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.376661 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.376822 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.377043 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.377300 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.377406 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.377654 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.377808 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.378017 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.378229 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.378396 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.378548 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.378746 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.378924 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.379120 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.379272 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.379508 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.379608 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.379881 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.380015 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.380279 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.380394 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.380626 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.380726 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.380973 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.381073 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.381319 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.381425 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.381668 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.381767 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.382061 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.382161 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.382432 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.382539 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.382785 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.382884 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.383145 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.383244 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.383495 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.383602 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.383849 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.383948 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.384222 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.384329 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.384576 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.384676 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.384929 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.385027 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.385281 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.385380 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.385645 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.385751 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.385994 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.386105 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.386347 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.386454 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.386687 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.386787 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.387044 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.387144 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.387389 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.387488 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.387739 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.387838 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.388134 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.388249 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.388492 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.388615 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.388842 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.388948 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.389199 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.389299 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.389562 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.389668 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.389914 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.390015 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.390325 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.390724 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.390838 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.391086 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.391191 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.391439 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.391540 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.391786 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.391887 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.392179 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.392281 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.392537 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.392637 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.392881 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.392981 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.393254 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.393354 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.393597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.393697 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.393943 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.394053 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.394289 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.394391 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.394640 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.394741 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.395026 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.395142 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.395339 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.395438 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.395708 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.395807 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.396130 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.396256 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.396451 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.396552 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.396803 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.396910 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.397153 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.397252 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.397513 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.397612 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.397859 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.397959 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.398204 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.398304 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.398547 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.398653 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.398901 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.399000 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.399251 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.399351 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.399602 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.399702 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.399945 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.400095 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.400352 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.400464 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.400683 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.400795 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.401051 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.401162 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.401420 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.401526 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.401767 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.401918 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.402132 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.402300 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.402514 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.402617 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.402792 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79712) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 02 15:38:22.402897 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.403226 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.403602 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:38:22.403880 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=79713) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 02 15:38:22.441842 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79713) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.442374 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.784992 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.context [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82295c62-8f78-451c-abd1-d999b48833ae(cell1) {{(pid=79712) load_cells /opt/stack/nova/nova/context.py:467}} Dec 02 15:38:22.787244 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.context [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82295c62-8f78-451c-abd1-d999b48833ae(cell1) {{(pid=79713) load_cells /opt/stack/nova/nova/context.py:467}} Dec 02 15:38:22.790453 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:38:22.792309 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:38:22.792713 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79713) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:38:22.793188 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:38:22.794526 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=79713) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:38:22.795395 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79713) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:38:22.797210 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:38:22.799245 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=79713) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:38:22.823236 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.824410 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79713) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.831449 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.836221 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79713) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.857370 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79712) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:22.861405 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_db.sqlalchemy.engines [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=79713) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:38:23.063326 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading Gnome Dec 02 15:38:23.085226 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading Google Dec 02 15:38:23.088768 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading Windows (alt) Dec 02 15:38:23.091523 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading Gnome Dec 02 15:38:23.093602 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading file Dec 02 15:38:23.094839 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading keyczar Dec 02 15:38:23.095285 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading multi Dec 02 15:38:23.096165 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Loading pyfs Dec 02 15:38:23.113288 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading Google Dec 02 15:38:23.116723 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading Windows (alt) Dec 02 15:38:23.121243 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading file Dec 02 15:38:23.122397 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading keyczar Dec 02 15:38:23.122844 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading multi Dec 02 15:38:23.123706 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO keyring.backend [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Loading pyfs Dec 02 15:38:23.381250 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:38:23.388569 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:38:23.426628 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:38:23.434083 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:38:23.727614 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:38:23.733481 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:38:23.739525 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611384dc9c0 pid: 79712 (default app) Dec 02 15:38:23.741862 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:38:23.743078 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-7fd7859d-22e1-4b7c-b3a5-0b2d3211c61f None None] 10.222.0.101 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001868 Dec 02 15:38:23.743508 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 1/1] 10.222.0.101 () {50 vars in 784 bytes} [Wed Dec 2 15:38:23 2020] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:38:23.789432 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:38:23.795292 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WARNING keystonemiddleware.auth_token [None req-cac572a6-74c4-4165-a32b-618ed20ab2c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:38:23.801966 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5611384dc9c0 pid: 79713 (default app) Dec 02 15:39:53.455563 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-1339509f-45b5-461b-9ba9-f80d62f304bb admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:39:53.482695 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-1339509f-45b5-461b-9ba9-f80d62f304bb admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.529246 Dec 02 15:39:53.483341 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 2/2] 10.222.0.101 () {58 vars in 1155 bytes} [Wed Dec 2 15:39:52 2020] GET /compute/v2.1/flavors/detail => generated 15 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:39:56.438950 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-5e5b4dc2-609e-4066-91a5-efe750024ad1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:39:56.469315 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:39:56.469315 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:39:56.534802 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-5e5b4dc2-609e-4066-91a5-efe750024ad1 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 369 microversion: 2.1 time: 0.469725 Dec 02 15:39:56.535539 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 1/3] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:39:56 2020] POST /compute/v2.1/flavors => generated 369 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:39:56.552592 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-329af0e1-7d65-485e-9c57-5e8e893e68c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:39:56.559735 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:39:56.559735 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:39:56.621980 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-329af0e1-7d65-485e-9c57-5e8e893e68c4 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.079234 Dec 02 15:39:56.622626 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 3/4] 10.222.0.101 () {62 vars in 1241 bytes} [Wed Dec 2 15:39:56 2020] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:39:56.638334 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-ba879b42-0c44-405b-aaed-f95b01d73de6 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:39:56.662620 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-ba879b42-0c44-405b-aaed-f95b01d73de6 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.033138 Dec 02 15:39:56.663224 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 2/5] 10.222.0.101 () {58 vars in 1188 bytes} [Wed Dec 2 15:39:56 2020] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:39:59.288986 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-1bcf319b-a10b-4a3f-84b6-60b2ac549efe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:39:59.318268 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:39:59.318268 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:39:59.405729 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-1bcf319b-a10b-4a3f-84b6-60b2ac549efe admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.208357 Dec 02 15:39:59.407246 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 4/6] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:39:59 2020] POST /compute/v2.1/flavors => generated 366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:39:59.424269 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-de48a6d2-f033-47fa-a5c4-de8ef8362ba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:39:59.430703 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:39:59.430703 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:39:59.530338 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-de48a6d2-f033-47fa-a5c4-de8ef8362ba8 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.115876 Dec 02 15:39:59.531985 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 3/7] 10.222.0.101 () {62 vars in 1241 bytes} [Wed Dec 2 15:39:59 2020] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:39:59.547887 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-bdd065f3-0ed9-4659-82dd-68150bc16508 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:39:59.568450 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-bdd065f3-0ed9-4659-82dd-68150bc16508 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030097 Dec 02 15:39:59.568973 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 5/8] 10.222.0.101 () {58 vars in 1188 bytes} [Wed Dec 2 15:39:59 2020] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:02.225126 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-89d67a4d-0082-4c6f-a969-ecaa837d6335 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:02.279089 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-89d67a4d-0082-4c6f-a969-ecaa837d6335 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.146957 Dec 02 15:40:02.279737 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 4/9] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:02 2020] POST /compute/v2.1/flavors => generated 366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:02.296827 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-5f1c848a-e19d-4201-9e47-070e669f980f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:02.385895 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-5f1c848a-e19d-4201-9e47-070e669f980f admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.098101 Dec 02 15:40:02.386536 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 6/10] 10.222.0.101 () {62 vars in 1241 bytes} [Wed Dec 2 15:40:02 2020] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:02.402774 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-60372c18-94c1-41b9-82fb-45373366f2f1 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:02.423194 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-60372c18-94c1-41b9-82fb-45373366f2f1 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.029163 Dec 02 15:40:02.423772 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 5/11] 10.222.0.101 () {58 vars in 1188 bytes} [Wed Dec 2 15:40:02 2020] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:05.092324 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-2f2b609c-bea2-4be9-8a9a-81f2a4c3e9f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:05.146400 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-2f2b609c-bea2-4be9-8a9a-81f2a4c3e9f1 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.143021 Dec 02 15:40:05.147023 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 7/12] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:05 2020] POST /compute/v2.1/flavors => generated 366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:05.163383 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-70623dbf-439f-4d60-9f11-23907c57c16c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:05.229704 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-70623dbf-439f-4d60-9f11-23907c57c16c admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.075652 Dec 02 15:40:05.230336 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 6/13] 10.222.0.101 () {62 vars in 1241 bytes} [Wed Dec 2 15:40:05 2020] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:05.246156 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-a54cd682-b599-4b85-b141-67151e77a048 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:05.267323 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-a54cd682-b599-4b85-b141-67151e77a048 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030023 Dec 02 15:40:05.267910 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 8/14] 10.222.0.101 () {58 vars in 1188 bytes} [Wed Dec 2 15:40:05 2020] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:07.915826 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-047a7d18-31a7-4abc-95e2-b1b68e6256aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:07.975010 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-047a7d18-31a7-4abc-95e2-b1b68e6256aa admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.150890 Dec 02 15:40:07.975554 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 7/15] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:07 2020] POST /compute/v2.1/flavors => generated 366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:07.992594 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-6d30ce7e-9ac3-457c-9498-68a62549e38c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:08.071875 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-6d30ce7e-9ac3-457c-9498-68a62549e38c admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.089227 Dec 02 15:40:08.072580 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 9/16] 10.222.0.101 () {62 vars in 1241 bytes} [Wed Dec 2 15:40:07 2020] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:08.088192 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-f6af52e2-6041-40b4-a83d-0508e58467d5 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:08.112028 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-f6af52e2-6041-40b4-a83d-0508e58467d5 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032926 Dec 02 15:40:08.112602 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 8/17] 10.222.0.101 () {58 vars in 1188 bytes} [Wed Dec 2 15:40:08 2020] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:10.767146 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-49bd70bd-e188-4308-9bc9-3873b2ac413f admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:10.788035 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-49bd70bd-e188-4308-9bc9-3873b2ac413f admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/detail" status: 200 len: 1796 microversion: 2.1 time: 0.110843 Dec 02 15:40:10.788658 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 10/18] 10.222.0.101 () {58 vars in 1155 bytes} [Wed Dec 2 15:40:10 2020] GET /compute/v2.1/flavors/detail => generated 1796 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:40:13.494045 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-cf4d4757-1ebf-494c-ac3a-d8fdc1d1f8ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:13.564911 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-cf4d4757-1ebf-494c-ac3a-d8fdc1d1f8ea admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.175748 Dec 02 15:40:13.565560 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 9/19] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:13 2020] POST /compute/v2.1/flavors => generated 364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:13.584955 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-34ed84b1-a80c-4462-858d-6e88179f7501 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:13.673220 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-34ed84b1-a80c-4462-858d-6e88179f7501 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.100483 Dec 02 15:40:13.673784 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 11/20] 10.222.0.101 () {62 vars in 1238 bytes} [Wed Dec 2 15:40:13 2020] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 02 15:40:13.690678 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-cec59be0-90cc-46d0-8dfd-015d46d58346 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:13.712676 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-cec59be0-90cc-46d0-8dfd-015d46d58346 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.031316 Dec 02 15:40:13.713430 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 10/21] 10.222.0.101 () {58 vars in 1185 bytes} [Wed Dec 2 15:40:13 2020] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:16.459695 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-a7fafb5f-a348-4448-8e7c-157c5bb79881 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:16.524654 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-a7fafb5f-a348-4448-8e7c-157c5bb79881 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.157667 Dec 02 15:40:16.525292 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 12/22] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:16 2020] POST /compute/v2.1/flavors => generated 367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:16.542183 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-a263a207-01be-40ee-978a-716eabe432b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:16.624692 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-a263a207-01be-40ee-978a-716eabe432b5 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.090874 Dec 02 15:40:16.625411 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 11/23] 10.222.0.101 () {62 vars in 1238 bytes} [Wed Dec 2 15:40:16 2020] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:16.641951 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-24151dac-6ceb-4ad5-927d-19d539f6d433 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:16.662915 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-24151dac-6ceb-4ad5-927d-19d539f6d433 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030649 Dec 02 15:40:16.663519 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 13/24] 10.222.0.101 () {58 vars in 1185 bytes} [Wed Dec 2 15:40:16 2020] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:19.433112 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-9ab9a621-2dcd-42a5-afa2-2fdde5567b08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:19.500595 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-9ab9a621-2dcd-42a5-afa2-2fdde5567b08 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.164434 Dec 02 15:40:19.501248 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 12/25] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:19 2020] POST /compute/v2.1/flavors => generated 368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:19.518629 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-874a66f6-801f-42b2-b382-fc6d0dfbce18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:19.645920 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-874a66f6-801f-42b2-b382-fc6d0dfbce18 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.136628 Dec 02 15:40:19.647058 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 14/26] 10.222.0.101 () {62 vars in 1238 bytes} [Wed Dec 2 15:40:19 2020] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:19.662889 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-68a2a32b-8bca-45cc-b974-102a21cea40a admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:19.684429 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-68a2a32b-8bca-45cc-b974-102a21cea40a admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030707 Dec 02 15:40:19.685059 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 13/27] 10.222.0.101 () {58 vars in 1185 bytes} [Wed Dec 2 15:40:19 2020] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:22.501191 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-df1f60e0-8a2f-4f55-bb17-ab70f4c80e88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:22.562500 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-df1f60e0-8a2f-4f55-bb17-ab70f4c80e88 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.156814 Dec 02 15:40:22.563141 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 15/28] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:22 2020] POST /compute/v2.1/flavors => generated 367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:22.580118 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-51d3db1d-e137-4c1e-bf38-007329e8b03d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:22.642636 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-51d3db1d-e137-4c1e-bf38-007329e8b03d admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.071878 Dec 02 15:40:22.643279 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 14/29] 10.222.0.101 () {62 vars in 1238 bytes} [Wed Dec 2 15:40:22 2020] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:22.659826 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-49ccd4c4-4b55-4246-8736-96ab83208407 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:22.682046 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-49ccd4c4-4b55-4246-8736-96ab83208407 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.032183 Dec 02 15:40:22.682575 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 16/30] 10.222.0.101 () {58 vars in 1185 bytes} [Wed Dec 2 15:40:22 2020] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:25.486947 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-184adc1a-a190-4cf0-aea2-31438507cabd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:25.556786 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-184adc1a-a190-4cf0-aea2-31438507cabd admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 370 microversion: 2.1 time: 0.160974 Dec 02 15:40:25.557437 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 15/31] 10.222.0.101 () {62 vars in 1188 bytes} [Wed Dec 2 15:40:25 2020] POST /compute/v2.1/flavors => generated 370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:40:25.574013 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0fc11419-bad5-4af5-8b36-a82351079e74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:40:25.642320 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0fc11419-bad5-4af5-8b36-a82351079e74 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.077283 Dec 02 15:40:25.642975 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 17/32] 10.222.0.101 () {62 vars in 1238 bytes} [Wed Dec 2 15:40:25 2020] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:40:25.659189 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-503877f0-d185-4662-ba3f-8ae9ce59f0da admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:40:25.679963 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-503877f0-d185-4662-ba3f-8ae9ce59f0da admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.030319 Dec 02 15:40:25.680587 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 16/33] 10.222.0.101 () {58 vars in 1185 bytes} [Wed Dec 2 15:40:25 2020] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:41:41.721839 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-4ccf920f-d939-4f90-8074-58018335b214 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:41.746185 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-4ccf920f-d939-4f90-8074-58018335b214 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/detail" status: 200 len: 3582 microversion: 2.1 time: 0.113340 Dec 02 15:41:41.746806 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 18/34] 10.222.0.101 () {58 vars in 1155 bytes} [Wed Dec 2 15:41:41 2020] GET /compute/v2.1/flavors/detail => generated 3582 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:41:43.408195 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-503877f0-d185-4662-ba3f-8ae9ce59f0da admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:43.409301 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-503877f0-d185-4662-ba3f-8ae9ce59f0da admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001597 Dec 02 15:41:43.409739 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 17/35] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:43 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:43.631253 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-d8b8d681-15fb-43dd-84a9-a9e1806412a8 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:43.646513 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.wsgi [None req-d8b8d681-15fb-43dd-84a9-a9e1806412a8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 02 15:41:43.647092 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-d8b8d681-15fb-43dd-84a9-a9e1806412a8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:41:43.647959 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-d8b8d681-15fb-43dd-84a9-a9e1806412a8 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.106896 Dec 02 15:41:43.648556 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 19/36] 10.222.0.101 () {60 vars in 1186 bytes} [Wed Dec 2 15:41:43 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 02 15:41:43.663838 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-3771130a-d86a-425b-92c0-0c92ade0b149 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:43.687069 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-3771130a-d86a-425b-92c0-0c92ade0b149 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.87 time: 0.031948 Dec 02 15:41:43.687667 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 18/37] 10.222.0.101 () {60 vars in 1206 bytes} [Wed Dec 2 15:41:43 2020] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:41:43.704039 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-7ddba5b4-99a7-4a59-8d69-8b3ab00d6d5b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:43.726267 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-7ddba5b4-99a7-4a59-8d69-8b3ab00d6d5b admin admin] 10.222.0.101 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.87 time: 0.031610 Dec 02 15:41:43.726876 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 20/38] 10.222.0.101 () {60 vars in 1206 bytes} [Wed Dec 2 15:41:43 2020] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:41:43.744871 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-307f81e2-4745-4328-8a9c-c0862bc08833 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:43.763627 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.wsgi [None req-307f81e2-4745-4328-8a9c-c0862bc08833 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 02 15:41:43.764429 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-307f81e2-4745-4328-8a9c-c0862bc08833 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=79713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:41:43.765349 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-307f81e2-4745-4328-8a9c-c0862bc08833 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.030063 Dec 02 15:41:43.765968 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 19/39] 10.222.0.101 () {60 vars in 1186 bytes} [Wed Dec 2 15:41:43 2020] GET /compute/v2.1/flavors/42 => generated 75 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 02 15:41:45.344971 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-7ddba5b4-99a7-4a59-8d69-8b3ab00d6d5b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:45.346074 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-7ddba5b4-99a7-4a59-8d69-8b3ab00d6d5b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001626 Dec 02 15:41:45.346509 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 21/40] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:45 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:45.565358 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-63b38924-67d6-4c9e-bdb4-180125e54d69 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:45.579460 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.wsgi [None req-63b38924-67d6-4c9e-bdb4-180125e54d69 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 02 15:41:45.580169 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-63b38924-67d6-4c9e-bdb4-180125e54d69 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:41:45.581048 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-63b38924-67d6-4c9e-bdb4-180125e54d69 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.105322 Dec 02 15:41:45.581652 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 20/41] 10.222.0.101 () {60 vars in 1186 bytes} [Wed Dec 2 15:41:45 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 02 15:41:45.597796 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-217c8a35-72c7-4901-99eb-8b316a330fff admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:45.623031 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-217c8a35-72c7-4901-99eb-8b316a330fff admin admin] 10.222.0.101 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.87 time: 0.034587 Dec 02 15:41:45.623644 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 22/42] 10.222.0.101 () {60 vars in 1206 bytes} [Wed Dec 2 15:41:45 2020] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:41:45.640394 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-af398ee6-7bfd-4f33-b351-602ca5db1742 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:45.666042 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-af398ee6-7bfd-4f33-b351-602ca5db1742 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.87 time: 0.035521 Dec 02 15:41:45.666635 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 21/43] 10.222.0.101 () {60 vars in 1206 bytes} [Wed Dec 2 15:41:45 2020] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:41:45.682714 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-2fd2d282-dc16-4fff-acd3-ba22ad476558 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:45.696633 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.wsgi [None req-2fd2d282-dc16-4fff-acd3-ba22ad476558 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 02 15:41:45.697256 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-2fd2d282-dc16-4fff-acd3-ba22ad476558 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=79712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:41:45.698105 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-2fd2d282-dc16-4fff-acd3-ba22ad476558 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.024359 Dec 02 15:41:45.699161 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 23/44] 10.222.0.101 () {60 vars in 1186 bytes} [Wed Dec 2 15:41:45 2020] GET /compute/v2.1/flavors/84 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 02 15:41:47.280722 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-af398ee6-7bfd-4f33-b351-602ca5db1742 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:47.281844 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-af398ee6-7bfd-4f33-b351-602ca5db1742 admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001609 Dec 02 15:41:47.282313 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 22/45] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:47 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:47.504179 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-3581fdaf-8555-462d-b186-94a2f43eaf64 admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:47.517970 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.wsgi [None req-3581fdaf-8555-462d-b186-94a2f43eaf64 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 02 15:41:47.518590 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-3581fdaf-8555-462d-b186-94a2f43eaf64 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:41:47.519447 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-3581fdaf-8555-462d-b186-94a2f43eaf64 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.108869 Dec 02 15:41:47.520053 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 24/46] 10.222.0.101 () {60 vars in 1189 bytes} [Wed Dec 2 15:41:47 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 02 15:41:47.535647 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-57049cd3-0e9a-448c-84a1-0f2243ef64ad admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:47.557387 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-57049cd3-0e9a-448c-84a1-0f2243ef64ad admin admin] 10.222.0.101 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.87 time: 0.030880 Dec 02 15:41:47.558492 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 23/47] 10.222.0.101 () {60 vars in 1206 bytes} [Wed Dec 2 15:41:47 2020] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:41:47.574848 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:47.596838 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.87 time: 0.031322 Dec 02 15:41:47.597443 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 25/48] 10.222.0.101 () {60 vars in 1206 bytes} [Wed Dec 2 15:41:47 2020] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:41:47.612982 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-c3e89079-f94d-472f-a6d3-f57d77144bbf admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:47.626690 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.wsgi [None req-c3e89079-f94d-472f-a6d3-f57d77144bbf admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 02 15:41:47.627309 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-c3e89079-f94d-472f-a6d3-f57d77144bbf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=79713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:41:47.628181 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-c3e89079-f94d-472f-a6d3-f57d77144bbf admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.024193 Dec 02 15:41:47.628740 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 24/49] 10.222.0.101 () {60 vars in 1189 bytes} [Wed Dec 2 15:41:47 2020] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 02 15:41:49.204445 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:49.205409 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001752 Dec 02 15:41:49.205892 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 26/50] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:49 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:49.436935 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-5c88c248-405f-47dd-b952-1a5ed53d33dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:41:49.508172 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-5c88c248-405f-47dd-b952-1a5ed53d33dc admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.87 time: 0.171564 Dec 02 15:41:49.508749 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 25/51] 10.222.0.101 () {64 vars in 1231 bytes} [Wed Dec 2 15:41:49 2020] POST /compute/v2.1/flavors => generated 406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:41:51.147390 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:51.148509 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001593 Dec 02 15:41:51.149057 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 27/52] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:51 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:51.376224 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-09e64dbc-db0e-4926-b3f4-86301271b8bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:41:51.439188 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-09e64dbc-db0e-4926-b3f4-86301271b8bc admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.155399 Dec 02 15:41:51.439792 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 26/53] 10.222.0.101 () {64 vars in 1231 bytes} [Wed Dec 2 15:41:51 2020] POST /compute/v2.1/flavors => generated 407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:41:53.037605 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:53.040199 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.003156 Dec 02 15:41:53.040660 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 28/54] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:53 2020] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:53.279904 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-f410acda-c8c5-4c3e-88f3-777eb3d60d09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:41:53.382570 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-f410acda-c8c5-4c3e-88f3-777eb3d60d09 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.195101 Dec 02 15:41:53.383172 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 27/55] 10.222.0.101 () {64 vars in 1231 bytes} [Wed Dec 2 15:41:53 2020] POST /compute/v2.1/flavors => generated 409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:41:54.960078 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:54.961164 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001613 Dec 02 15:41:54.961595 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 29/56] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:54 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:55.201063 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-24a45010-969a-410d-875c-9e7af85c35d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:41:55.273427 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-24a45010-969a-410d-875c-9e7af85c35d2 admin admin] 10.222.0.101 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.87 time: 0.171226 Dec 02 15:41:55.274054 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 28/57] 10.222.0.101 () {64 vars in 1231 bytes} [Wed Dec 2 15:41:55 2020] POST /compute/v2.1/flavors => generated 411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:41:56.839964 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:56.840633 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002367 Dec 02 15:41:56.840949 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 30/58] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:41:56 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:41:57.062539 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-f00ef638-3aec-42ca-8ff3-b5f4166c4a65 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:41:57.115645 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-f00ef638-3aec-42ca-8ff3-b5f4166c4a65 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.87 time: 0.145771 Dec 02 15:41:57.121835 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 29/59] 10.222.0.101 () {60 vars in 1198 bytes} [Wed Dec 2 15:41:56 2020] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:42:50.237381 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:42:50.238439 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-961ecc11-bbbc-4a2e-89f9-46f21180574b admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001538 Dec 02 15:42:50.238867 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 31/60] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:42:50 2020] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:42:50.464097 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:42:50.497809 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] 10.222.0.101 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.87 time: 0.127133 Dec 02 15:42:50.498409 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 30/61] 10.222.0.101 () {60 vars in 1198 bytes} [Wed Dec 2 15:42:50 2020] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:44:16.901232 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-b36129e5-bae9-4436-a63f-d6e5dc58262a tempest-verify_tempest_config-1805404591 tempest-verify_tempest_config-1805404591] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:44:16.907911 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-b36129e5-bae9-4436-a63f-d6e5dc58262a tempest-verify_tempest_config-1805404591 tempest-verify_tempest_config-1805404591] 10.222.0.101 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.171962 Dec 02 15:44:16.908587 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 32/62] 10.222.0.101 () {58 vars in 1129 bytes} [Wed Dec 2 15:44:16 2020] GET /compute/v2.1/extensions => generated 22700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:46:02.263568 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:02.264687 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001597 Dec 02 15:46:02.265118 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 31/63] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:46:02 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:46:02.562341 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-9dc101be-5865-43dd-8a3b-796da8c3fcfb admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:02.569121 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:46:02.569121 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:46:02.570744 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-9dc101be-5865-43dd-8a3b-796da8c3fcfb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:02.571244 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-9dc101be-5865-43dd-8a3b-796da8c3fcfb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:02.572123 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-9dc101be-5865-43dd-8a3b-796da8c3fcfb admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:02.572641 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-9dc101be-5865-43dd-8a3b-796da8c3fcfb admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:02.606183 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-9dc101be-5865-43dd-8a3b-796da8c3fcfb admin admin] 10.222.0.101 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.210155 Dec 02 15:46:02.606795 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 33/64] 10.222.0.101 () {60 vars in 1189 bytes} [Wed Dec 2 15:46:02 2020] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:46:04.186534 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:04.187613 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001532 Dec 02 15:46:04.188075 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 32/65] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:46:04 2020] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:46:04.412745 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-564572b2-1cc1-426b-b573-eedd1ad8932e admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:04.419071 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:46:04.419071 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:46:04.420784 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-564572b2-1cc1-426b-b573-eedd1ad8932e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:04.421281 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-564572b2-1cc1-426b-b573-eedd1ad8932e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:04.422138 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-564572b2-1cc1-426b-b573-eedd1ad8932e admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:04.422620 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-564572b2-1cc1-426b-b573-eedd1ad8932e admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:04.451741 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-564572b2-1cc1-426b-b573-eedd1ad8932e admin admin] 10.222.0.101 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.131809 Dec 02 15:46:04.452397 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 34/66] 10.222.0.101 () {60 vars in 1189 bytes} [Wed Dec 2 15:46:04 2020] GET /compute/v2.1/os-services => generated 791 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:46:16.451597 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:16.452749 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001596 Dec 02 15:46:16.453180 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 33/67] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:46:16 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:46:16.669268 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0a714239-9721-4cef-9139-400f2bfb4dea admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:16.675535 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:46:16.675535 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:46:16.677143 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-0a714239-9721-4cef-9139-400f2bfb4dea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:16.677642 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-0a714239-9721-4cef-9139-400f2bfb4dea admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:16.678493 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-0a714239-9721-4cef-9139-400f2bfb4dea admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:16.678975 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-0a714239-9721-4cef-9139-400f2bfb4dea admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:16.712811 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0a714239-9721-4cef-9139-400f2bfb4dea admin admin] 10.222.0.101 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.133207 Dec 02 15:46:16.713419 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 35/68] 10.222.0.101 () {60 vars in 1189 bytes} [Wed Dec 2 15:46:16 2020] GET /compute/v2.1/os-services => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:46:18.356521 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] Calling method '>' {{(pid=79713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:18.357609 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-0deee78d-0044-4357-b410-7a540ebc7206 admin admin] 10.222.0.101 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001626 Dec 02 15:46:18.358040 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79713|app: 0|req: 34/69] 10.222.0.101 () {56 vars in 1070 bytes} [Wed Dec 2 15:46:18 2020] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:46:18.589101 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG nova.api.openstack.wsgi [None req-88e9dd9c-5b96-4424-be71-ff89400b803f admin admin] Calling method '>' {{(pid=79712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:46:18.595585 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:46:18.595585 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: warnings.warn(msg) Dec 02 15:46:18.597850 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-88e9dd9c-5b96-4424-be71-ff89400b803f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:18.598340 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-88e9dd9c-5b96-4424-be71-ff89400b803f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:18.599189 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-88e9dd9c-5b96-4424-be71-ff89400b803f admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:46:18.599666 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: DEBUG oslo_concurrency.lockutils [None req-88e9dd9c-5b96-4424-be71-ff89400b803f admin admin] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=79712) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:46:18.628381 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: INFO nova.api.openstack.requestlog [None req-88e9dd9c-5b96-4424-be71-ff89400b803f admin admin] 10.222.0.101 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.134983 Dec 02 15:46:18.628979 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: [pid: 79712|app: 0|req: 36/70] 10.222.0.101 () {60 vars in 1189 bytes} [Wed Dec 2 15:46:18 2020] GET /compute/v2.1/os-services => generated 1035 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:47:19.949198 dv-cinder-737618-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 02 15:47:19.950129 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: Wed Dec 2 15:47:19 2020 - graceful shutdown triggered... Dec 02 15:47:19.950602 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: Gracefully killing worker 2 (pid: 79713)... Dec 02 15:47:19.950784 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: Gracefully killing worker 1 (pid: 79712)... Dec 02 15:47:20.951032 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: worker 1 buried after 1 seconds Dec 02 15:47:20.951032 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: worker 2 buried after 1 seconds Dec 02 15:47:20.951032 dv-cinder-737618-2-iscsi devstack@n-api.service[79711]: goodbye to uWSGI. Dec 02 15:47:20.952850 dv-cinder-737618-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 02 15:47:20.956294 dv-cinder-737618-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 02 15:47:20.967286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: *** Starting uWSGI 2.0.15-debian (64bit) on [Wed Dec 2 15:47:20 2020] *** Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: nodename: dv-cinder-737618-2-iscsi Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: machine: x86_64 Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: clock source: unix Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: pcre jit disabled Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: detected number of CPU cores: 4 Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: current working directory: / Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: detected binary path: /usr/bin/uwsgi-core Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: dropping root privileges as early as possible Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: your processes number limit is 47843 Dec 02 15:47:20.969351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: your memory page size is 4096 bytes Dec 02 15:47:20.970318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: detected max file descriptor number: 2048 Dec 02 15:47:20.970318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: lock engine: pthread robust mutexes Dec 02 15:47:20.970318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: thunder lock: enabled Dec 02 15:47:20.970318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 02 15:47:20.970318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: dropping root privileges after socket binding Dec 02 15:47:20.970318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Dec 02 15:47:21.021741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Python main interpreter initialized at 0x5651337d69c0 Dec 02 15:47:21.021741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: dropping root privileges after plugin initialization Dec 02 15:47:21.021741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: python threads support enabled Dec 02 15:47:21.021741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: your server socket listen backlog is limited to 100 connections Dec 02 15:47:21.021741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: your mercy for graceful operations on workers is 90 seconds Dec 02 15:47:21.022381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: mapped 402621 bytes (393 KB) for 2 cores Dec 02 15:47:21.022381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: *** Operational MODE: preforking *** Dec 02 15:47:21.022555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: dropping root privileges after application loading Dec 02 15:47:21.022555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: *** uWSGI is running in multiple interpreter mode *** Dec 02 15:47:21.022555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: spawned uWSGI master process (pid: 94389) Dec 02 15:47:21.022659 dv-cinder-737618-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 02 15:47:21.022980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: spawned uWSGI worker 1 (pid: 94390, cores: 1) Dec 02 15:47:21.023299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: spawned uWSGI worker 2 (pid: 94391, cores: 1) Dec 02 15:47:21.023408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 02 15:47:25.645431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 02 15:47:25.645988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 02 15:47:25.647803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 02 15:47:25.648333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 02 15:47:25.648636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 02 15:47:25.649119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.649554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.649875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.650271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.650643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.651011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.651404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.651767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.652166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.652538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.652926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.653231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.653599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.653981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-2-iscsi {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.654361 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.654717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.655080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.655455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.655812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.656217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.656575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.657207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.657533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.657897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.658255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.658653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.659014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.659340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Dec 02 15:47:25.659450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.659680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Dec 02 15:47:25.659784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.660075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.660458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.660818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.661199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-2-iscsi {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.661316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Dec 02 15:47:25.661574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.661688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Dec 02 15:47:25.662006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Dec 02 15:47:25.662113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.662468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.662581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.662868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.662997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.663207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] bandwidth_poll_interval = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.663313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.663590 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] bindir = /usr/local/bin {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.663695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.663948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.664092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.664334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.664438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.664714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.664831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.665057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.665177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.665420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.665527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.665777 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.665877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.666145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.666251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.666407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.666505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.666765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.666871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.667136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-737618-2-iscsi {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.667233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.667500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.667607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.667840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.667950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.668227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.668384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.668533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.668673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.668812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.668961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.669163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.669502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.669502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.669820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.669970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.670137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.670300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.670455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.670605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.670745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.670884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.671086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.671238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.671452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.671630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.671775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.671916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.672114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.672257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.672593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.672767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.672914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.673978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-737618-2-iscsi {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.674127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.674267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.674872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.675911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.676092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.101 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.676265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.676415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.101 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.676556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.676708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.676858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.677007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.677147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.677293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.677445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.678113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.678281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.678476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.678642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.678788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.679132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.679285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.679425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.679570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.679730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.679871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.680950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.681096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.681283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.681429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.681662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.681817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.681965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.682105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.682244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.682393 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.682540 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.682868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.683893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.684065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.684218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.684371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.684522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.685238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.685396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.685539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.685686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.685827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.685980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.686121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.686260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.686404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.686544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.686690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.686852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.687867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.101 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.101 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.688936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.689181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.689411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.689634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.689781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.689920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.690930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.691069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.691208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.691355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.691494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.691649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.691869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.692042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.692189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.692343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.692491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.692638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.692803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.693113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.693803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.693963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.694110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.694252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.694399 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.694545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.694693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.694927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.695403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.695552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.695699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.695851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.696903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.697919 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.698058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.698205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.698351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.698500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.698647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.698795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.698935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.699074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.699306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.699480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.699736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.699896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.699896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.700251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.700392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.700544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.700685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.700991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.701178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.701329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.701481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.701629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.701770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.702030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.702183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.702324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.702476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.702617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.702757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.702904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.703241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.703394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.703546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.703694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.703840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.704005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.704170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.704312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.704511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.704668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.704810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.705053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.705632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.705788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.705939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.706080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.706220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.706360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.706652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.706652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.706956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.707103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.707103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.707377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.708125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.708236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.708316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.708398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.708480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.708607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.708692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.708806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.708882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.708955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.709038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.709112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.709190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.709484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.709583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.709731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.709842 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Dec 02 15:47:25.710073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.710183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.710437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.710547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.710811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.710982 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.711203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.711381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.711575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.711748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.711947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.712145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.712311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.712501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.712683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.712900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.713012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.713330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.713442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.713694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.713803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.714057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.714176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.714413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.714523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.714768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.714882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.715116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.715228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.715735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.715838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.716124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.716227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.716488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.716657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.716812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.716957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.717169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.717331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.717488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.717640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.717850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.718012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.718156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.718298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.718519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.718693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.718854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.719003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.719208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.719372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.719566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.719731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.719915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.720193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.720360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.720505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.720650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.720800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.720951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.721094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.721736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.721908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.721908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.722206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.722358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.722520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.722680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.722836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.722994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.723150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.723306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.723484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.723640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.723790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.723945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.724130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.724287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.724525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.724791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.725062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.725592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.725769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.725924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.726105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.726263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.726430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.727900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.728281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.728439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.728596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.728751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.728907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.729068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.729240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.729240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.729697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.729848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.730004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.730164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.730324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.730479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.730627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.730627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.731134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.731286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.731503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.731503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.732282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.732450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.732613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.732764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.732912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.733975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.734130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.734279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.734443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.734591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.734745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.734909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.735071 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.735233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.735451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.735603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.735750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.735897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.736092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.736255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.736406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.736554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.736725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.737122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.737480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.737652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.737802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.737966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.738122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.738270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.738420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.738577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.738732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.738936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.739094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.739254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.739412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.739672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.739834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.740582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.740804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.740960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.741117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.741436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.741600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.741774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.742268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.742427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.742591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.742749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.742907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.743963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.744152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.744303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.744460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.744610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.744766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.744930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.745086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.745234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.745451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.745615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.745774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.745929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.746097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.746285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.746436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.746585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.746740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.746889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.747291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.747662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.747821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.747996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.748152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.748299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.748447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.748606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.748762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.748920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.749076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.749224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.749379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.749547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.749790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.749952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.750108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.750256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.750415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.750572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.750721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.allowed_direct_url_schemes = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.750875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.751031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.751184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.751344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.751508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.751664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.751819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.752360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.752527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.752751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.752903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.753972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.754268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.754423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.754582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.754731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.754885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.755033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.755181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.755335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.755490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.756240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.756569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.756775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.756940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.757102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.757527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.757897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.758962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.759111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.759275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.759437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.759585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.759733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.759998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.760706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.760863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761347 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.761812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.762103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.762628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.762797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.762797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.763092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.763092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.763391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.763391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.763683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.763683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.764068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.764244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.764395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.764543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.764701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.764973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.765150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.765303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.765451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.765606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.765765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.765927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.766089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.766255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.766404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.766560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.766710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.766858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.767014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.767168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.767168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.767758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.768173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.768332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.768495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.768667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.768941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.769156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.769311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.769460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.769460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.769763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.769921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.770181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.770343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.770501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.770651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.770799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.770961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.771120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.771318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.771507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.771765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.772040 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.772225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.772392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.772968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.773132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.773282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.773438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.773588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.773754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.773904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774675 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.774992 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.775149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.775347 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.775504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.775669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.775841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.776072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.776231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.776380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.776529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.776687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.776854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.777006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.777156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.777303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.777303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.777909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778341 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.778855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.779887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.780996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.781894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.782706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783830 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.783939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.784990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.785997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.786894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.787084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.787315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.787489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.787678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.787870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.788103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.788273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.788448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.788599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.788769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.788936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.789101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.789263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.789417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.789583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.789749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.789903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.790130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.790333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.790500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.790606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.790790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.790913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.791139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.791264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.791513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.791634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.791862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.792017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.792231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.792362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.792575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.792685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.792916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.793025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.793273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.793506 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.793670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.793824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.793991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.794143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.794315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.794470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.794623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.794789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.794943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.795097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.795267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.795432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.795594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.795759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.795924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.796063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.796360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.796476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.796673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.796767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.797023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.797119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.797426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.797783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.798216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.798387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.798545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.798709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.798859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.799079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.799238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.799453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.799611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.799825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.800007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.800221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.800379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.800586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.800762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.800941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.801196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.801364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.801521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.801676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.801825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.801985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.802141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.802329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.803253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.803414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.803572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.803739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.803960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.804222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.804373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.804530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.804692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.804840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.804994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.805148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.805296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.805449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.805606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.805754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.805910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.806972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.807126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.807274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.807429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.807589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.807793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.807962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.808382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.808625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.808787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.808946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.809095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.809251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.809406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.809610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.809776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.809925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.810086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.810281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.810438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.810635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.810799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.810992 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.811149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.811415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.811572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.811733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.811888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.812064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.812230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.812380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.812545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.812761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.812926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.813339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.813514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.813665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.813820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.813970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.814123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.814280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.814435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.814584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.814797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.814959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.815115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.815275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.815430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.815578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.815734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.815888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.816100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.816261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.816409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.816563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.816720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.816869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.817032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.817186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.817400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.817570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.817757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.817982 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.819111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.819385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.819563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.819724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.819875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.819875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.820210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.820366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.820514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.820670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.820818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.820966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.821119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.821280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.821445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.821699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.821857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_usb_tablet = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.822921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.823068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.823215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.823609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.823765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.823912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.824087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.824236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.824386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.824553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.824701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.824857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.825917 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826845 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.826999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.827154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.827310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.827457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.827606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.827817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.828012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.828245 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.828396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.828545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.828709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.828874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.829240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.829406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.829556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.829704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.829859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.830939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.831099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.831254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.831401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.831548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.831721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.831967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.832157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.832317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.832466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.832613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.832767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.832930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.833198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.833355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.833772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.833948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.834100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.834253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.834419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.834419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.834721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.834943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.835093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.835248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.835407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.835554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.835701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.835857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.836971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.837125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.837274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.837437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.837591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.837750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.837910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.838081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.838429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.838593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.838755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.838912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.839072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.839441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.839604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.839755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.839920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.840106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.840264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.840264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.840798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.840946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.841102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.841252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.841406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.841561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.841717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.841865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.842915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.843207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.843363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.843512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.843680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.844145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.844308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.844470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.844626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.844782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.844954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.845244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.845409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.845566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.845721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.845869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.846951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.847108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.847263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.847413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.847561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.847710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.847872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.848065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.848232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.848387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.848547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.848702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.848861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.849020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.849175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.849561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.849723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.849885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.850105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.850105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.850406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.850570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.850729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.850888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.851941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.852157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.852306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.852480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.852650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.852818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.852967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.853121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.853276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.853424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.853583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.853733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.854857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.855028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.855179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.855429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.855594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.855744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.855903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.856128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.856280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.856440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.856625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.856808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.856967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.857186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.857344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.857506 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.857662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.857662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.857956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.858104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.858250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.858405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.858553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.858708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.858862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.859013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.859162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.859322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.859494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.859861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860223 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.860980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.861136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.861293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.861441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.861595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.861743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.861897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.862953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.863126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.863337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.863492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.863640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.863640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.863947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.864180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.864339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.864488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.864643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.864792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.865828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.866942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.867096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.867250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.867250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.867533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.867751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.867901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.868150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.868302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.868458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.868618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.868775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.868930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.869096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.869244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.869392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.869558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.869933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.870091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.870246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.870401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.870401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.870704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.870853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871777 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.871925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.872117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.872267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.872267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.872560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.872709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.872855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.873918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.874954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.875121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.875270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.875417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.875568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.875718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.875887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.876086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.876246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.876395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.876549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.876698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.876857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.877923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.878075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.878250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.878407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.878555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.878710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.878859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.879014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.879311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.879470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.879639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.879806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.880192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.880343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.880501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.880703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.880870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.881535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.881693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.881901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.882068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.882232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.882394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.882597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.882755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.882962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.883127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.883314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.883479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.883628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.883782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.883998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.884161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.884358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.884527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.884683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.884838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.885040 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.885198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.885359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.885510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.885703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.885866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.886022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.886171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.886380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.886554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.886704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.886858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.887045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.887202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.887442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.887599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.887797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.887961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.888156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.888426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.888598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.888812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.888990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.889140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.889289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.889517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.889682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.889883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.890197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.890197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.890497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.890660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.890863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891185 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.891933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.892177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.892335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.892485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.892634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.892782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.892930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.893147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.893320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.893477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.893627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.893814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.893972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.894129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.894279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.894482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.894654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.894868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.895025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.895184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.895346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.895543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.895913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.896121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.896310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.896310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.896605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.896761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.896996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.897153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.897354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.897519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.897709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.897883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.898033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.898188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.898402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.898554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.898744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.898903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.899093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.899250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.899410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.899609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.899778 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.899935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.900115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.900326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.900493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.900662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.900818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.900990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.901145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.901320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.901475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.901698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.901867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.902075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.902232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.902448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.902565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.902793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.902947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.903137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.903299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.903457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.903613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.903770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.903919 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.904195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.904369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.904576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.904734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.904928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.905095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.905251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.905412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.905634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.905792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.905984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.906143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.906337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.906565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.906723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.906950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.907104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.907254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.907402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.907562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.907719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.907868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.908052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.908209 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.908357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.908537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.908745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.908907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909223 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.909991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.910139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.910457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.910620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.910772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.910921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.911077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.911244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.911402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.911559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.911714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.911893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.912134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.912305 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.912464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.912616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.912772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.912959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.913119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.913287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.913437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.913594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.913744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.913892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.914093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.914260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.914419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.914576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.914787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.914952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.915138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.915305 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.915463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.915613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.915811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.916035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.916212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.916363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.916520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.916750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.916909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.917136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.917303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.917452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94390) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 02 15:47:25.917610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.917843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.918217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.918575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.918934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.919288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.919637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.920042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.920396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.920752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.921100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.921449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.921806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.922160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.922583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.923132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.923507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.923878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.924301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.924656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.925048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.925427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Dec 02 15:47:25.925705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94391) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Dec 02 15:47:25.955682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:25.962807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.228381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.context [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82295c62-8f78-451c-abd1-d999b48833ae(cell1) {{(pid=94390) load_cells /opt/stack/nova/nova/context.py:467}} Dec 02 15:47:26.229696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.context [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82295c62-8f78-451c-abd1-d999b48833ae(cell1) {{(pid=94391) load_cells /opt/stack/nova/nova/context.py:467}} Dec 02 15:47:26.236336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:47:26.237017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:47:26.238318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:47:26.238910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:47:26.239268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:47:26.239866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:47:26.242672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:47:26.243058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:47:26.270455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.271937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.272495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.273387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.305947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.310640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_db.sqlalchemy.engines [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 02 15:47:26.475633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading Gnome Dec 02 15:47:26.477684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading Gnome Dec 02 15:47:26.496811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading Google Dec 02 15:47:26.498413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading Google Dec 02 15:47:26.500234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading Windows (alt) Dec 02 15:47:26.501837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading Windows (alt) Dec 02 15:47:26.505150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading file Dec 02 15:47:26.506498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading keyczar Dec 02 15:47:26.507020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading file Dec 02 15:47:26.507136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading multi Dec 02 15:47:26.507814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Loading pyfs Dec 02 15:47:26.508103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading keyczar Dec 02 15:47:26.508555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading multi Dec 02 15:47:26.509408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO keyring.backend [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Loading pyfs Dec 02 15:47:26.795090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:47:26.796308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:47:26.802502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:47:26.804165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:47:27.144015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:47:27.144199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 02 15:47:27.149928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-254f803b-c2a1-4e2d-96dc-438205dde107 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:47:27.150072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WARNING keystonemiddleware.auth_token [None req-3ccfff2b-245e-4a17-b41e-acb3302c2597 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 02 15:47:27.155521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651337d69c0 pid: 94390 (default app) Dec 02 15:47:27.155681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651337d69c0 pid: 94391 (default app) Dec 02 15:48:07.221934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-885f9872-bbce-4b65-89d4-e56f29c8768c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Action: 'create', calling method: .version_select at 0x7f0271c20378>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-941608719"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:09.185249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-885f9872-bbce-4b65-89d4-e56f29c8768c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.472740 Dec 02 15:48:09.186627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 1/1] 10.222.0.101 () {60 vars in 1150 bytes} [Wed Dec 2 15:48:05 2020] POST /compute/v2.1/os-volumes => generated 344 bytes in 3476 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Dec 02 15:48:09.443716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1a57ecec-6606-4d3b-afb8-676856df70a1 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271c88ea0>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:10.024479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-453968633", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "0e8d58a1-9518-45ad-8e30-37b570122f7b"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:10.180691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1a57ecec-6606-4d3b-afb8-676856df70a1 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 200 len: 344 microversion: 2.1 time: 0.983865 Dec 02 15:48:10.181300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 1/2] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:48:09 2020] GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 344 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:10.192290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] validate_networks() for [('0e8d58a1-9518-45ad-8e30-37b570122f7b', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:48:11.205618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-26c1fcc3-43b3-4dec-a44a-8cf391c5cd0e tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271ae8488>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:11.381911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:48:11.381911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:48:11.381911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:48:11.381911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:48:11.381911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:48:11.504850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:11.505911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:11.507041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:11.507761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:11.535465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-26c1fcc3-43b3-4dec-a44a-8cf391c5cd0e tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 200 len: 345 microversion: 2.1 time: 0.344967 Dec 02 15:48:11.536429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 2/3] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:48:11 2020] GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 345 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:11.540901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:11.548419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for user 792f7ff55fec492a8cf35f9e27c85210 and project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:11.554909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d293b563-e3e4-4bc0-a744-70ead8d80043 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Action: 'create', calling method: .version_select at 0x7f0271bc2d90>, body: {"snapshot": {"volume_id": "8fa3c792-6455-4191-aa72-7b3816a8066c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2124020354"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:11.564808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:48:11.569614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:48:11.720908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8d7d434a-6efe-42d1-b596-357349f79677 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.049649 Dec 02 15:48:11.722329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 2/4] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:48:09 2020] POST /compute/v2.1/servers => generated 382 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:48:11.749225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-415618d0-ced0-437b-99ec-b8ed8373f6d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:11.751095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-415618d0-ced0-437b-99ec-b8ed8373f6d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:12.026972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-415618d0-ced0-437b-99ec-b8ed8373f6d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:12.061196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-415618d0-ced0-437b-99ec-b8ed8373f6d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1221 microversion: 2.1 time: 0.327793 Dec 02 15:48:12.069069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 3/5] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:11 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1221 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:12.204327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d293b563-e3e4-4bc0-a744-70ead8d80043 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.659894 Dec 02 15:48:12.204965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 3/6] 10.222.0.101 () {60 vars in 1157 bytes} [Wed Dec 2 15:48:11 2020] POST /compute/v2.1/os-snapshots => generated 287 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:48:12.247378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-08643a76-2289-46e6-acbb-f60998c072db tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0275a04620>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:12.391652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-08643a76-2289-46e6-acbb-f60998c072db tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.172596 Dec 02 15:48:12.392792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 4/7] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:12 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:12.418132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-727feb90-c2ff-412a-b865-08fb6476b71c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271bc2b70>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:12.477527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-447446345", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "e9552d4f-e707-48bc-a8bf-2f1d46861609"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:12.505646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-727feb90-c2ff-412a-b865-08fb6476b71c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.105557 Dec 02 15:48:12.510441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 5/8] 10.222.0.101 () {58 vars in 1135 bytes} [Wed Dec 2 15:48:12 2020] GET /compute/v2.1/os-snapshots => generated 290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:12.532510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-00723706-aa56-42a3-91bf-6c3a76bbe692 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271bfcae8>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:12.621682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-00723706-aa56-42a3-91bf-6c3a76bbe692 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.103669 Dec 02 15:48:12.622344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 6/9] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:12 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:48:12.719829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] validate_networks() for [('e9552d4f-e707-48bc-a8bf-2f1d46861609', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:48:13.094455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-50dcc206-dc41-41f0-b28a-031707a775c1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:13.095312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-50dcc206-dc41-41f0-b28a-031707a775c1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:13.322611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-50dcc206-dc41-41f0-b28a-031707a775c1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:13.357545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-50dcc206-dc41-41f0-b28a-031707a775c1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1221 microversion: 2.1 time: 0.282459 Dec 02 15:48:13.358579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 7/10] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:13 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1221 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:48:13.663762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5e084c05-18fe-4da2-8478-e3840085f67d tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271bfcd90>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:13.793380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5e084c05-18fe-4da2-8478-e3840085f67d tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.148413 Dec 02 15:48:13.794850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 8/11] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:13 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:14.383988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:14.385274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:14.406537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:14.414546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:14.416953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:14.419391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:14.770352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:14.790292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-993e1947-1a1a-44a5-a9cc-980501dd5769 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1225 microversion: 2.1 time: 0.416332 Dec 02 15:48:14.792182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 9/12] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:14 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1225 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:14.820519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5d782a98-59a6-408b-9758-72f233ca75ad tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271a73bf8>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:14.888041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5d782a98-59a6-408b-9758-72f233ca75ad tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.083032 Dec 02 15:48:14.888644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 10/13] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:14 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:48:15.126122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:48:15.126599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:48:15.127140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:48:15.127601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:48:15.128108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:48:15.147422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:15.147901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:15.148990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:15.149648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:15.171588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Getting quotas for project cfa8264f106340e3bae2ec60311e66f3. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:15.176278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Getting quotas for user dbbde01a5d114cd598c87133e11599ef and project cfa8264f106340e3bae2ec60311e66f3. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:15.188525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:48:15.192282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:48:15.288375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-009f7e63-412f-40df-b92b-7454cd971505 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.137564 Dec 02 15:48:15.289687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 4/14] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:48:12 2020] POST /compute/v2.1/servers => generated 382 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Dec 02 15:48:15.316334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-50ebaa82-1a1e-431b-abcd-bbda7c8444c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:15.319210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-50ebaa82-1a1e-431b-abcd-bbda7c8444c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:15.608397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-50ebaa82-1a1e-431b-abcd-bbda7c8444c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:15.654488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-50ebaa82-1a1e-431b-abcd-bbda7c8444c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1218 microversion: 2.1 time: 0.355489 Dec 02 15:48:15.657018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 11/15] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:15 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1218 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:15.834961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:15.839614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:15.867323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:15.876891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:15.881597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:15.883152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:15.913040 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fc82bfc0-9149-4aa9-a7ad-e2e1855221b0 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f027534fbf8>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:16.004926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fc82bfc0-9149-4aa9-a7ad-e2e1855221b0 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 288 microversion: 2.1 time: 0.106693 Dec 02 15:48:16.012245 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 12/16] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:15 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:16.029185 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-33ec9d7d-7271-4846-87ae-fce917057782 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271a73048>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:16.284348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-33ec9d7d-7271-4846-87ae-fce917057782 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "DELETE /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 202 len: 0 microversion: 2.1 time: 0.270789 Dec 02 15:48:16.286302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 13/17] 10.222.0.101 () {58 vars in 1249 bytes} [Wed Dec 2 15:48:16 2020] DELETE /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:48:16.310066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7acedb4d-d015-4a4c-9536-081967d71e1c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271a73b70>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:16.476798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7acedb4d-d015-4a4c-9536-081967d71e1c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.185351 Dec 02 15:48:16.477580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 14/18] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:16 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:16.588438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:16.679816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bf7d5755-f5f6-4b68-a948-5cb348e54d2b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:16.681087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bf7d5755-f5f6-4b68-a948-5cb348e54d2b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:16.708263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7acc0814-91fb-42f8-9abd-ad02c9247930 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1225 microversion: 2.1 time: 0.901100 Dec 02 15:48:16.710202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 5/19] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:15 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1225 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:16.803043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf7d5755-f5f6-4b68-a948-5cb348e54d2b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:16.811766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bf7d5755-f5f6-4b68-a948-5cb348e54d2b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1218 microversion: 2.1 time: 0.141544 Dec 02 15:48:16.812751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 15/20] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:16 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:48:17.497111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c84a9117-ac11-4c09-9df1-bc75cb19539c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f02711b7ea0>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:17.563334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c84a9117-ac11-4c09-9df1-bc75cb19539c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.077224 Dec 02 15:48:17.564303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 6/21] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:17 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:17.743163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:17.743852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:17.764020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:17.764797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:17.765801 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:17.766588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:17.839507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:17.844267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:17.863056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:17.863929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:17.869977 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:17.873650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:18.257754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:18.271851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cedae90c-798f-47ee-9185-7f1c7827d57f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1217 microversion: 2.1 time: 0.548124 Dec 02 15:48:18.272477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 16/22] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:17 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1217 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:18.291169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:18.302689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f930b0cf-899f-4ec9-9725-05454d354156 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1222 microversion: 2.1 time: 0.473475 Dec 02 15:48:18.304634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 7/23] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:17 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1222 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:18.584153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b279776f-fb49-4ca3-b756-7e7d417e87ad tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271a62ea0>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:18.733832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b279776f-fb49-4ca3-b756-7e7d417e87ad tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 200 len: 287 microversion: 2.1 time: 0.161169 Dec 02 15:48:18.734938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 17/24] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:18 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:19.308344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:19.313240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:19.347067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:19.355012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:19.355012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:19.355012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:19.355012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:19.364986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:19.383636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:19.388445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:19.393102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:19.398385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:19.854401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:19.895135 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7855ed84-5a61-478e-b5dc-ec36d8a8a080 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1273 microversion: 2.1 time: 0.604254 Dec 02 15:48:19.899821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 8/25] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:19 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1273 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:19.972949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b2654250-565b-497e-bc0d-0d79feec1a98 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271151378>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:20.229033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-b2654250-565b-497e-bc0d-0d79feec1a98 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] HTTP exception thrown: Snapshot b97cdae8-f62c-4365-abd2-d0b05849db5f could not be found. Dec 02 15:48:20.229033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b2654250-565b-497e-bc0d-0d79feec1a98 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Returning 404 to user: Snapshot b97cdae8-f62c-4365-abd2-d0b05849db5f could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:48:20.229033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b2654250-565b-497e-bc0d-0d79feec1a98 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f" status: 404 len: 111 microversion: 2.1 time: 0.308957 Dec 02 15:48:20.229033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 9/26] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 15:48:19 2020] GET /compute/v2.1/os-snapshots/b97cdae8-f62c-4365-abd2-d0b05849db5f => generated 111 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:48:20.255523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9736f8f7-6f6c-4249-b1ee-33f1679cfdb9 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271145268>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:20.368304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:20.395255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-697f6962-e06c-4e85-9048-f33def05ead3 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1214 microversion: 2.1 time: 1.063842 Dec 02 15:48:20.403507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 18/27] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:19 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1214 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:20.710133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9736f8f7-6f6c-4249-b1ee-33f1679cfdb9 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "DELETE /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 202 len: 0 microversion: 2.1 time: 0.480281 Dec 02 15:48:20.719304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 10/28] 10.222.0.101 () {58 vars in 1243 bytes} [Wed Dec 2 15:48:20 2020] DELETE /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:48:20.739520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f6a8293a-7233-4a2d-b3ef-b0f3fd0a1d1c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271a73510>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:20.928187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:20.928899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:21.005571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:21.006119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:21.021293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:21.024284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:21.259468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f6a8293a-7233-4a2d-b3ef-b0f3fd0a1d1c tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 200 len: 344 microversion: 2.1 time: 0.543655 Dec 02 15:48:21.261131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 19/29] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:48:20 2020] GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 344 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:21.445041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:21.448732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:21.470066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:21.473060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:21.474180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:21.475293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:22.034697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:22.092545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-96b52373-080c-44a1-beca-7f5b4faabf86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1279 microversion: 2.1 time: 1.136602 Dec 02 15:48:22.092545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 11/30] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:20 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1279 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:22.283552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-41bf1225-82a3-41d5-9f67-13863481243f tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f02711451e0>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:22.380936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:22.409069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d3546c30-c17c-4ca1-a1e8-8abc2808cd6a tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1288 microversion: 2.1 time: 0.988507 Dec 02 15:48:22.419692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 20/31] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:21 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1288 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:48:22.490302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-41bf1225-82a3-41d5-9f67-13863481243f tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] HTTP exception thrown: Volume 8fa3c792-6455-4191-aa72-7b3816a8066c could not be found. Dec 02 15:48:22.491065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-41bf1225-82a3-41d5-9f67-13863481243f tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Returning 404 to user: Volume 8fa3c792-6455-4191-aa72-7b3816a8066c could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:48:22.492233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-41bf1225-82a3-41d5-9f67-13863481243f tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 404 len: 109 microversion: 2.1 time: 0.219481 Dec 02 15:48:22.493325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 12/32] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:48:22 2020] GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 109 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:48:22.525750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e679cb58-9353-4b8d-a53a-1f98759f5f91 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271a077b8>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:22.701473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-e679cb58-9353-4b8d-a53a-1f98759f5f91 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] HTTP exception thrown: Volume 8fa3c792-6455-4191-aa72-7b3816a8066c could not be found. Dec 02 15:48:22.702157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e679cb58-9353-4b8d-a53a-1f98759f5f91 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Returning 404 to user: Volume 8fa3c792-6455-4191-aa72-7b3816a8066c could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:48:22.703111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e679cb58-9353-4b8d-a53a-1f98759f5f91 tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "DELETE /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 404 len: 109 microversion: 2.1 time: 0.188910 Dec 02 15:48:22.703717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 21/33] 10.222.0.101 () {58 vars in 1243 bytes} [Wed Dec 2 15:48:22 2020] DELETE /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:48:22.723576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c4b5d842-4d0d-47c8-9f2d-daa3952304ce tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Calling method '.version_select at 0x7f0271151d08>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:22.936652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-c4b5d842-4d0d-47c8-9f2d-daa3952304ce tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] HTTP exception thrown: Volume 8fa3c792-6455-4191-aa72-7b3816a8066c could not be found. Dec 02 15:48:22.937530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c4b5d842-4d0d-47c8-9f2d-daa3952304ce tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] Returning 404 to user: Volume 8fa3c792-6455-4191-aa72-7b3816a8066c could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:48:22.938891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c4b5d842-4d0d-47c8-9f2d-daa3952304ce tempest-VolumesSnapshotsTestJSON-1838196102 tempest-VolumesSnapshotsTestJSON-1838196102] 10.222.0.101 "GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c" status: 404 len: 109 microversion: 2.1 time: 0.230425 Dec 02 15:48:22.939648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 13/34] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:48:22 2020] GET /compute/v2.1/os-volumes/8fa3c792-6455-4191-aa72-7b3816a8066c => generated 109 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 02 15:48:23.125398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:23.146123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:23.181216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:23.181953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:23.189666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:23.189855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:23.466659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:23.480942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:23.528118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:23.531281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:23.532493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:23.541204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:23.891625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:23.936136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-36ced4f8-c8c3-45b6-b476-96b81c641176 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1279 microversion: 2.1 time: 0.833878 Dec 02 15:48:23.937379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 22/35] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:23 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1279 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:23.972211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:24.000031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7854c5cb-aec7-4014-a034-fbce4f92b013 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1276 microversion: 2.1 time: 0.564382 Dec 02 15:48:24.004918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 14/36] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:23 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1276 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:24.963743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:24.970333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:24.993860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:25.007339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:25.009293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:25.012572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:25.047462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:25.055438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:25.098709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:25.103184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:25.107654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:25.108493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:25.363659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:25.404443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c33f4e5c-b0f7-490b-820c-e8202c418388 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1279 microversion: 2.1 time: 0.449851 Dec 02 15:48:25.406127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 23/37] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:24 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1279 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:25.950286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:25.976140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fcf7223a-d4ca-4122-9d2a-6188818d2b69 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1276 microversion: 2.1 time: 0.942748 Dec 02 15:48:25.996267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 15/38] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:25 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1276 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:26.446316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:26.447292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:26.467578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:26.468663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:26.469679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:26.470328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:27.012017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:27.013986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:27.034173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:27.038632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:27.039780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:27.044241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:27.853394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:27.873774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f8bb0912-468c-44f3-af6c-42d73e204f68 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1276 microversion: 2.1 time: 0.875858 Dec 02 15:48:27.875620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 16/39] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:26 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1276 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:28.757028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:28.781417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8270436e-14de-49c4-9cbb-0e8d33c7c91c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 2.355463 Dec 02 15:48:28.782545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 24/40] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:26 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:28.903575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:28.918408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:28.963153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:28.963755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:28.964876 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:28.965366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:30.435616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1822889948", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9cb3801-fac6-4035-8677-bcb9a7cab836"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:30.785736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] validate_networks() for [('b9cb3801-fac6-4035-8677-bcb9a7cab836', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:48:33.388838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:33.411920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f8936038-befd-4b83-ad02-52373df706fa tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 4.521925 Dec 02 15:48:33.415446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 17/41] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:28 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 4526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:33.443266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:33.444716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:33.467111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:33.468122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:33.469336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:33.472780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:36.351691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:48:36.352315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:48:36.352727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:48:36.353195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:48:36.354311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:48:36.387888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:36.388440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:36.389344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:36.389844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:36.466957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Getting quotas for project 8cbb7ca3f3664f78b99b77c653d6109a. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:36.483952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Getting quotas for user 6b2b57e9310b48d19cc45c504b90eb4e and project 8cbb7ca3f3664f78b99b77c653d6109a. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:36.508465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:48:36.511627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:48:36.712624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-47fe9bda-5fcb-422a-9500-0e131b189ce4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 7.268704 Dec 02 15:48:36.720129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 25/42] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:48:29 2020] POST /compute/v2.1/servers => generated 385 bytes in 7278 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:48:36.744645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:36.745502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:36.761792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:36.762819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:36.764720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:36.778130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:37.450904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:37.461510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9008c9d1-8f22-43ea-a4e0-51a4a67d1984 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 0.739750 Dec 02 15:48:37.462337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 26/43] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:36 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:37.664979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:37.689449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b85011b7-46b8-4332-8e82-0262245710fa tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 4.267370 Dec 02 15:48:37.690091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 18/44] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:33 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 4269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:37.708194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7703b66e-3377-40d7-aa06-46e7e6b2c732 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:37.709301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7703b66e-3377-40d7-aa06-46e7e6b2c732 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:37.772290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-c74b6174-def2-4ec3-abfc-a9ff69a45093 req-1f9ef2c3-e7fa-4805-ac2d-867b515188c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86e0adf-e547-4dc7-a347-22a102b5928e", "tag": "18ae3e68-f199-402b-ad16-0125e857e166"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:37.785307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:37.785307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:37.806452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-c74b6174-def2-4ec3-abfc-a9ff69a45093 req-1f9ef2c3-e7fa-4805-ac2d-867b515188c5 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:37.807191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-c74b6174-def2-4ec3-abfc-a9ff69a45093 req-1f9ef2c3-e7fa-4805-ac2d-867b515188c5 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:37.858004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-c74b6174-def2-4ec3-abfc-a9ff69a45093 req-1f9ef2c3-e7fa-4805-ac2d-867b515188c5 service nova] Creating event network-changed:18ae3e68-f199-402b-ad16-0125e857e166 for instance e86e0adf-e547-4dc7-a347-22a102b5928e on hv-cinder-73761 Dec 02 15:48:37.858004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-c74b6174-def2-4ec3-abfc-a9ff69a45093 req-1f9ef2c3-e7fa-4805-ac2d-867b515188c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:48:37.858004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:37.858004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:37.858004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:37.858550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:37.881215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.compute.rpcapi [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 02 15:48:37.888348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] Releasing lock "compute-rpcapi-router" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:48:37.953369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d12cbb49-1ed0-4bb9-a36d-8956179f4ccb None None] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.489447 Dec 02 15:48:37.954248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 27/45] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:37 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:38.139408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7703b66e-3377-40d7-aa06-46e7e6b2c732 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:38.167881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7703b66e-3377-40d7-aa06-46e7e6b2c732 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1226 microversion: 2.1 time: 0.473943 Dec 02 15:48:38.168589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 19/46] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:37 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1226 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:38.419881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1589321730", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9cb3801-fac6-4035-8677-bcb9a7cab836"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:38.486047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:38.487858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:38.497514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:38.498389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:38.499395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:38.500088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:38.613982 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] validate_networks() for [('b9cb3801-fac6-4035-8677-bcb9a7cab836', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:48:40.365581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:40.389359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-259fca4e-8825-4e63-b6f0-284aa1b8aba9 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 1.913010 Dec 02 15:48:40.392209 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 20/47] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:38 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:40.407056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:40.407890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:40.430130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:40.430817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:40.442839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:40.443516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:41.188736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:48:41.188736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:48:41.189406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:48:41.190191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:48:41.190569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:48:41.217453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:41.217453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:41.217453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:41.217761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:41.255709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Getting quotas for project 8cbb7ca3f3664f78b99b77c653d6109a. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:41.272823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Getting quotas for user 6b2b57e9310b48d19cc45c504b90eb4e and project 8cbb7ca3f3664f78b99b77c653d6109a. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:41.293489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:48:41.297766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:48:41.534206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d619bfb5-42c7-482c-b0ce-130e8e0e99eb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.129306 Dec 02 15:48:41.544146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 28/48] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:48:38 2020] POST /compute/v2.1/servers => generated 385 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:48:41.938953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:41.971352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b7c85549-f3f0-4430-aaf0-1eb3c1b45768 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 1.572098 Dec 02 15:48:41.973959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 21/49] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:40 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:42.290141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4fa6aa18-1f07-4df0-9c6c-051d6d5cec85 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: .version_select at 0x7f02710c3158>, body: {"keypair": {"name": "tempest-keypair-383944555"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:42.395372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4fa6aa18-1f07-4df0-9c6c-051d6d5cec85 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:42.411608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4fa6aa18-1f07-4df0-9c6c-051d6d5cec85 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for user 4b34c14f9d8a4a1d885f449b18e7bf5f and project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:42.447022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-61d4baf3-7e84-400c-9767-d85fdc46bb89 req-5f76b7e3-5bf7-4f31-90f8-ae948ba51262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fd7e98-e386-4d4c-8795-01ea862e34ee", "tag": "10125ed7-437d-4e72-b3b3-ee3b47b41c2f"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:42.467398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:42.467398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:42.493212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-61d4baf3-7e84-400c-9767-d85fdc46bb89 req-5f76b7e3-5bf7-4f31-90f8-ae948ba51262 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:42.498963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-61d4baf3-7e84-400c-9767-d85fdc46bb89 req-5f76b7e3-5bf7-4f31-90f8-ae948ba51262 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:42.556435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-61d4baf3-7e84-400c-9767-d85fdc46bb89 req-5f76b7e3-5bf7-4f31-90f8-ae948ba51262 service nova] Creating event network-changed:10125ed7-437d-4e72-b3b3-ee3b47b41c2f for instance 01fd7e98-e386-4d4c-8795-01ea862e34ee on hv-cinder-73761 Dec 02 15:48:42.562650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-61d4baf3-7e84-400c-9767-d85fdc46bb89 req-5f76b7e3-5bf7-4f31-90f8-ae948ba51262 service nova] Acquired lock "compute-rpcapi-router" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:48:42.566053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:42.566053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:42.570429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:42.571158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:42.590226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.compute.rpcapi [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 02 15:48:42.595780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] Releasing lock "compute-rpcapi-router" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:48:42.662231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-58017fc1-7f93-46a5-9bb5-b8d63a5f94ba None None] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.685247 Dec 02 15:48:42.662907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 22/50] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:41 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:42.674591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:42.676114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:42.715008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:42.715523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:42.716694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:42.717216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:42.889962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4fa6aa18-1f07-4df0-9c6c-051d6d5cec85 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:42.902154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4fa6aa18-1f07-4df0-9c6c-051d6d5cec85 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for user 4b34c14f9d8a4a1d885f449b18e7bf5f and project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:42.978568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4fa6aa18-1f07-4df0-9c6c-051d6d5cec85 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.433147 Dec 02 15:48:42.984688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 29/51] 10.222.0.101 () {60 vars in 1153 bytes} [Wed Dec 2 15:48:41 2020] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:43.021136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:43.021810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:43.060234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:43.060765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:43.061637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:43.062131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:43.429427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:43.451348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4b0d3f21-b1bd-4af7-ac92-5bf4cdfb918d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1222 microversion: 2.1 time: 0.465180 Dec 02 15:48:43.452585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 30/52] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:42 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1222 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:43.479379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:43.480229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:43.500713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:43.506184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:43.506184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:43.506184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:43.821783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:43.848106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-925a1046-bb2f-4356-a879-d1952b34a6a2 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 1.174016 Dec 02 15:48:43.848106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 23/53] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:42 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:44.274067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4ca4ee3d-a527-44bd-b2cb-726c9ea31443 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'create', calling method: .version_select at 0x7f02710b70d0>, body: {"keypair": {"name": "tempest-keypair-8068724"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:44.391513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4ca4ee3d-a527-44bd-b2cb-726c9ea31443 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:44.405917 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4ca4ee3d-a527-44bd-b2cb-726c9ea31443 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for user 7231feb43e2144b890005197f88f34ba and project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:45.141029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:45.192023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7bdfb0b3-2d80-4f98-a35d-2ac5b7f19e38 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 1.737709 Dec 02 15:48:45.207274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 31/54] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:43 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:45.253813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:45.275379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:45.302856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:45.320244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:45.324991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:45.329463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:45.814029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4ca4ee3d-a527-44bd-b2cb-726c9ea31443 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:45.834891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-4ca4ee3d-a527-44bd-b2cb-726c9ea31443 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for user 7231feb43e2144b890005197f88f34ba and project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:45.906258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4ca4ee3d-a527-44bd-b2cb-726c9ea31443 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 201 len: 2317 microversion: 2.20 time: 2.065217 Dec 02 15:48:45.920312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 24/55] 10.222.0.101 () {62 vars in 1194 bytes} [Wed Dec 2 15:48:43 2020] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 2070 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 02 15:48:45.943552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:45.944509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:45.970067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:45.970885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:45.972016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:45.973159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:46.493001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:46.522237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-77a6fd4b-8aec-419a-87d8-96b6c4d02939 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1284 microversion: 2.1 time: 1.313005 Dec 02 15:48:46.523436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 32/56] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:45 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1284 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:46.745440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:46.768444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cc3fc0c4-9ab4-4264-9f32-9b45d124220d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 0.852060 Dec 02 15:48:46.770015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 25/57] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:45 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:46.790037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:46.791205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:46.801680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:46.802362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:46.803781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:46.804445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:47.113365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ecbd8eed-2870-41a4-922d-4810532fce7e req-164b55fd-36c2-4219-b2c3-002569137541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86e0adf-e547-4dc7-a347-22a102b5928e", "name": "network-vif-plugged", "status": "completed", "tag": "18ae3e68-f199-402b-ad16-0125e857e166"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:47.131758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:47.131758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:47.167253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ecbd8eed-2870-41a4-922d-4810532fce7e req-164b55fd-36c2-4219-b2c3-002569137541 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:47.167903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ecbd8eed-2870-41a4-922d-4810532fce7e req-164b55fd-36c2-4219-b2c3-002569137541 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:47.210278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ecbd8eed-2870-41a4-922d-4810532fce7e req-164b55fd-36c2-4219-b2c3-002569137541 service nova] Creating event network-vif-plugged:18ae3e68-f199-402b-ad16-0125e857e166 for instance e86e0adf-e547-4dc7-a347-22a102b5928e on hv-cinder-73761 Dec 02 15:48:47.225115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ecbd8eed-2870-41a4-922d-4810532fce7e req-164b55fd-36c2-4219-b2c3-002569137541 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.699688 Dec 02 15:48:47.225870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 33/58] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:46 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:47.367653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:47.381539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-28261247-0187-4d4b-a985-a04befdb2202 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 0.609913 Dec 02 15:48:47.385840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 26/59] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:46 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:47.547647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:47.553127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:47.563625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:47.564460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:47.567931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:47.568604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:47.791413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:47.797275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:47.811921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:47.812903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:47.814446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:47.815296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:47.853868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:47.877269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bd8a4496-caa6-48ac-922f-d58a8c647b01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1284 microversion: 2.1 time: 0.340049 Dec 02 15:48:47.881400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 34/60] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:47 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1284 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:48.405821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:48.409680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:48.428232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:48.431775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:48.432804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:48.434042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:48.772328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:48.795161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e86ad020-1474-4b78-9c75-84a5b1656429 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 1.013966 Dec 02 15:48:48.801783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 27/61] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:47 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:48.910068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:48.910968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:48.926610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:48.929383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:48.930437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:48.931136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:49.352914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:49.374813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-aebde395-7feb-4e80-ac1d-16fb02670e28 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1284 microversion: 2.1 time: 0.480296 Dec 02 15:48:49.383303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 28/62] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:48 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1284 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:48:49.635342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-5462e6ad-37cc-4e8e-ba00-0151af2ac119 req-3f4e88f2-c81d-41ab-b0e2-88ecc12278f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd7e98-e386-4d4c-8795-01ea862e34ee", "name": "network-vif-plugged", "status": "completed", "tag": "10125ed7-437d-4e72-b3b3-ee3b47b41c2f"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:49.662106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:49.662106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:49.672703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5462e6ad-37cc-4e8e-ba00-0151af2ac119 req-3f4e88f2-c81d-41ab-b0e2-88ecc12278f3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:49.673417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5462e6ad-37cc-4e8e-ba00-0151af2ac119 req-3f4e88f2-c81d-41ab-b0e2-88ecc12278f3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:49.700866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-5462e6ad-37cc-4e8e-ba00-0151af2ac119 req-3f4e88f2-c81d-41ab-b0e2-88ecc12278f3 service nova] Creating event network-vif-plugged:10125ed7-437d-4e72-b3b3-ee3b47b41c2f for instance 01fd7e98-e386-4d4c-8795-01ea862e34ee on hv-cinder-73761 Dec 02 15:48:49.708828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-5462e6ad-37cc-4e8e-ba00-0151af2ac119 req-3f4e88f2-c81d-41ab-b0e2-88ecc12278f3 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095528 Dec 02 15:48:49.710068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 29/63] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:49 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:48:49.762117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:49.777862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4aa4605a-1373-448d-92e2-fc5bec69e891 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 1.381406 Dec 02 15:48:49.779951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 35/64] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:48 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:48:49.848279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:49.849850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:49.907622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:49.909911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:49.910991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:49.911735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:50.406729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:50.407398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:50.434910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:50.435524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:50.442216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:50.447538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:51.040526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:51.050294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1458b1f6-bcce-4e5d-85f0-5561111c01e0 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 1.233894 Dec 02 15:48:51.050930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 30/65] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:49 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:51.062920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-e5020bdb-d75f-4285-b269-455fc52b422e req-513710a4-d8a3-4ec2-b962-6e300c21f969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "151ef38d-ba70-4859-93d6-24b1aad15e27", "tag": "033ff3dd-4a44-4c88-8208-f4ce9a19a0e6"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:51.073463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:51.073463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:51.090010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e5020bdb-d75f-4285-b269-455fc52b422e req-513710a4-d8a3-4ec2-b962-6e300c21f969 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:51.090527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e5020bdb-d75f-4285-b269-455fc52b422e req-513710a4-d8a3-4ec2-b962-6e300c21f969 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:51.114330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-e5020bdb-d75f-4285-b269-455fc52b422e req-513710a4-d8a3-4ec2-b962-6e300c21f969 service nova] Creating event network-changed:033ff3dd-4a44-4c88-8208-f4ce9a19a0e6 for instance 151ef38d-ba70-4859-93d6-24b1aad15e27 on hv-cinder-73761 Dec 02 15:48:51.120394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-e5020bdb-d75f-4285-b269-455fc52b422e req-513710a4-d8a3-4ec2-b962-6e300c21f969 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067998 Dec 02 15:48:51.122422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 31/66] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:51 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:51.135853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:51.137140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:51.147829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:51.148362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:51.149248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:51.149775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:51.834652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:51.857001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-88c62409-cf13-4d9d-a13c-c1bc718197c9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 1.460951 Dec 02 15:48:51.859339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 36/67] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:50 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:52.100614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:52.101426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:52.141849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:52.142339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:52.145025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:52.146080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:52.370967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:52.383432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3e451275-17e0-4324-8c6b-f726913a9fa5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1321 microversion: 2.1 time: 1.259160 Dec 02 15:48:52.384520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 32/68] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:51 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1321 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:52.883011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:52.884812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:52.894120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:52.894798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:52.896004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:52.896627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:53.373419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:53.387352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-604726be-2cac-45fe-8cf5-c38a1155b5bd tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1318 microversion: 2.1 time: 1.311995 Dec 02 15:48:53.388229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 37/69] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:52 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1318 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:53.410602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:53.411286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:53.419587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:53.422650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:53.426041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:53.426578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:54.070524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:54.113601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-919fa730-d736-4538-98e3-8eb424be26ac tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1510 microversion: 2.1 time: 0.712143 Dec 02 15:48:54.115458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 38/70] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:53 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1510 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:54.157741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:54.177422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6693b8c8-1726-42c5-8058-e6538982b005 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 1.306032 Dec 02 15:48:54.178207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 33/71] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:52 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:48:54.420923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:54.420923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:54.431520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:54.432043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:54.434571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:54.436705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:54.626071 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-682622410", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92487b79-3b7b-42f3-8b9b-942f6ba445e1"}], "security_groups": [{"name": "tempest-securitygroup--62295944"}], "key_name": "tempest-keypair-383944555", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:55.017417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] validate_networks() for [('92487b79-3b7b-42f3-8b9b-942f6ba445e1', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:48:55.442873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:55.455050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-92fcb1a6-2a18-4f49-99d6-b564a4b381c5 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1504 microversion: 2.1 time: 1.052094 Dec 02 15:48:55.456410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 39/72] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:54 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1504 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:55.469878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:55.473478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:55.503780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:55.504449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:55.505619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:55.507156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:56.020807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:56.043032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-49c5d64e-98c6-41a4-a2e6-c3531580bd2b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 0.585231 Dec 02 15:48:56.043610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 40/73] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:55 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:56.076980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-a21edfa5-e792-48d8-9b45-1a13fb24525d req-1298e88c-55ab-4172-8357-7270081f5f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b68ba3-ad18-47ee-80c0-8282bdd3368b", "tag": "befb71b0-ee0d-4d99-a7e5-e25e48227efc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:56.086610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:56.086610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:56.119864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-a21edfa5-e792-48d8-9b45-1a13fb24525d req-1298e88c-55ab-4172-8357-7270081f5f87 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:56.121775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-a21edfa5-e792-48d8-9b45-1a13fb24525d req-1298e88c-55ab-4172-8357-7270081f5f87 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:56.157289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-a21edfa5-e792-48d8-9b45-1a13fb24525d req-1298e88c-55ab-4172-8357-7270081f5f87 service nova] Creating event network-changed:befb71b0-ee0d-4d99-a7e5-e25e48227efc for instance 62b68ba3-ad18-47ee-80c0-8282bdd3368b on hv-cinder-73761 Dec 02 15:48:56.171504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-a21edfa5-e792-48d8-9b45-1a13fb24525d req-1298e88c-55ab-4172-8357-7270081f5f87 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116343 Dec 02 15:48:56.175066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 41/74] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:56 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:56.210413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1282901702", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26c8fb3a-cf2f-41d8-b18f-a75a5ab07959"}], "security_groups": [{"name": "tempest-securitygroup--1148376898"}], "key_name": "tempest-keypair-8068724", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:56.372520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:48:56.373235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:48:56.374177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:48:56.376459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:48:56.377875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:48:56.404043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:56.408045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:56.409083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:56.409940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:56.439395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:56.447054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for user 4b34c14f9d8a4a1d885f449b18e7bf5f and project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:56.481446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:48:56.484836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:48:56.604491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-119110f3-8b87-453a-830b-b03bd77e3ffe tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.992540 Dec 02 15:48:56.605767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 34/75] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:48:54 2020] POST /compute/v2.1/servers => generated 402 bytes in 1995 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:48:56.639110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9e2b83c-3ed5-4a2b-9849-328840203604"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:56.640382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:56.672809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:56.673325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:56.675010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:56.675505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:56.853753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] validate_networks() for [('26c8fb3a-cf2f-41d8-b18f-a75a5ab07959', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:48:57.638961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2c0b9753-e068-45a7-916e-6ea08fe57bef tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030932 Dec 02 15:48:57.639607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 35/76] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:48:56 2020] POST /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e/os-volume_attachments => generated 194 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:57.707558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-921eb249-0e2a-46bb-af59-864eb57df4b6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:57.707558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-921eb249-0e2a-46bb-af59-864eb57df4b6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:57.843117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-921eb249-0e2a-46bb-af59-864eb57df4b6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:57.855369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-921eb249-0e2a-46bb-af59-864eb57df4b6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1240 microversion: 2.1 time: 0.186158 Dec 02 15:48:57.856170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 36/77] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:57 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1240 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:57.871176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-7a6c3673-67b9-441f-ab31-64f758fb2b61 req-b0632236-5504-4743-a3fb-7105f85844e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151ef38d-ba70-4859-93d6-24b1aad15e27", "name": "network-vif-plugged", "status": "completed", "tag": "033ff3dd-4a44-4c88-8208-f4ce9a19a0e6"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:57.880983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:48:57.880983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:48:57.905933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-7a6c3673-67b9-441f-ab31-64f758fb2b61 req-b0632236-5504-4743-a3fb-7105f85844e1 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:57.907759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-7a6c3673-67b9-441f-ab31-64f758fb2b61 req-b0632236-5504-4743-a3fb-7105f85844e1 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:57.962272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-7a6c3673-67b9-441f-ab31-64f758fb2b61 req-b0632236-5504-4743-a3fb-7105f85844e1 service nova] Creating event network-vif-plugged:033ff3dd-4a44-4c88-8208-f4ce9a19a0e6 for instance 151ef38d-ba70-4859-93d6-24b1aad15e27 on hv-cinder-73761 Dec 02 15:48:57.981597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-7a6c3673-67b9-441f-ab31-64f758fb2b61 req-b0632236-5504-4743-a3fb-7105f85844e1 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121983 Dec 02 15:48:57.991243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 37/78] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:48:57 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:58.014499 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:58.015844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:58.026116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:58.026820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:58.028730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:58.029430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:58.350282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:58.360980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2dd51fa4-5391-4bc6-8115-57cfa87a45b8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 0.367456 Dec 02 15:48:58.362002 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 38/79] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:57 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:58.385467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46196b76-b4c1-43c6-b18c-9894520cf5ee"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:48:58.386794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:58.396738 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:58.397549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:58.398501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:58.399078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:58.879273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:48:58.879722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:48:58.881038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:48:58.881270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:48:58.881736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:48:58.892521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:58.893029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:58.893907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:58.894404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:58.958820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for project db296e2b87e34627b69487c0870d6fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:48:58.963500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for user 7231feb43e2144b890005197f88f34ba and project db296e2b87e34627b69487c0870d6fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:48:58.976063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:48:58.979394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:48:59.143253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-08080bdc-9972-4fb4-863f-dca82442cbe9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 2.964372 Dec 02 15:48:59.144198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 42/80] 10.222.0.101 () {62 vars in 1183 bytes} [Wed Dec 2 15:48:56 2020] POST /compute/v2.1/servers => generated 404 bytes in 2966 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 02 15:48:59.158317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:59.159285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:59.182884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:59.184004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:59.185602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:59.186118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:59.363203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:59.386621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2629469d-c181-43b9-b65d-8845509677a8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1292 microversion: 2.1 time: 0.227673 Dec 02 15:48:59.386621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 43/81] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:59 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:48:59.388691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3f6b67a8-a916-458b-b67e-ce631d36e023 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:59.389446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3f6b67a8-a916-458b-b67e-ce631d36e023 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:59.392977 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d2346a2d-6c8d-4a0f-a774-35432d7b4ff1 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "POST /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.018600 Dec 02 15:48:59.393945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 39/82] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:48:58 2020] POST /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:48:59.406058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:48:59.406805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:48:59.426718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:59.427439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:59.428532 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:48:59.429566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:48:59.537255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3f6b67a8-a916-458b-b67e-ce631d36e023 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:59.555471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3f6b67a8-a916-458b-b67e-ce631d36e023 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:59.599895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3f6b67a8-a916-458b-b67e-ce631d36e023 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:59.604254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3f6b67a8-a916-458b-b67e-ce631d36e023 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1283 microversion: 2.20 time: 0.226936 Dec 02 15:48:59.604965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 44/83] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:48:59 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1283 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:48:59.853363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:48:59.866544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b22ddb97-e456-47b6-b478-f5565cc082e2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 0.467787 Dec 02 15:48:59.867809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 40/84] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:48:59 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:00.404054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:00.404731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:00.413061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:00.413577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:00.414437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:00.414906 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:00.577736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:00.595960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5ff53954-84e8-48f5-b1bb-2c4e90c9feb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1298 microversion: 2.1 time: 0.201217 Dec 02 15:49:00.597462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 45/85] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:00 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:00.635528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:00.637405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:00.657052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:00.658580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:00.660392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:00.661119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:00.891778 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:00.893057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:00.904160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:00.905068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:00.906328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:00.906994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:00.928544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:00.947868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:00.956853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:00.958349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b7053351-a942-4b08-a5bd-716848abed54 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1335 microversion: 2.20 time: 0.336574 Dec 02 15:49:00.959472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 41/86] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:00 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1335 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:01.377897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:01.397851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-656131b2-4357-4b4f-ba6f-006d376f9444 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 0.517067 Dec 02 15:49:01.401953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 46/87] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:00 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:01.622349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:01.623768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:01.635994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:01.637137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:01.638788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:01.639469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:01.989195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:01.997959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:02.024012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:02.025634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:02.026511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:02.027006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:02.240772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:02.258438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0476ec33-cdb9-4043-9a25-2726bea6f391 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.647344 Dec 02 15:49:02.259060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 42/88] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:01 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:02.349044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:02.364979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:02.371953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:02.373201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b334c502-c505-47a4-aaea-5348a7fb69da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1341 microversion: 2.20 time: 0.394432 Dec 02 15:49:02.374381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 47/89] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:01 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1341 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:02.387433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-92d2aadc-81ce-4878-99b3-23dc669ce97a req-466ed606-8cf5-4a7c-82b1-d438515e6d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b68ba3-ad18-47ee-80c0-8282bdd3368b", "name": "network-vif-plugged", "status": "completed", "tag": "befb71b0-ee0d-4d99-a7e5-e25e48227efc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:02.395918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:02.395918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:02.405997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-92d2aadc-81ce-4878-99b3-23dc669ce97a req-466ed606-8cf5-4a7c-82b1-d438515e6d40 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:02.406481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-92d2aadc-81ce-4878-99b3-23dc669ce97a req-466ed606-8cf5-4a7c-82b1-d438515e6d40 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:02.424794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:02.425474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:02.433063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-92d2aadc-81ce-4878-99b3-23dc669ce97a req-466ed606-8cf5-4a7c-82b1-d438515e6d40 service nova] Creating event network-vif-plugged:befb71b0-ee0d-4d99-a7e5-e25e48227efc for instance 62b68ba3-ad18-47ee-80c0-8282bdd3368b on hv-cinder-73761 Dec 02 15:49:02.441133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-92d2aadc-81ce-4878-99b3-23dc669ce97a req-466ed606-8cf5-4a7c-82b1-d438515e6d40 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067842 Dec 02 15:49:02.442328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 43/90] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:02 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:49:02.448907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:02.449486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:02.450417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:02.450912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:03.290431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:03.291335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:03.312192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:03.312714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:03.313611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:03.324025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:03.647104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:03.662699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-973786cf-3c53-4582-97ee-64df899e38e7 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 1.247561 Dec 02 15:49:03.664983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 48/91] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:02 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:03.678640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:03.679349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:03.687605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:03.688145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:03.689053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:03.690835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:03.864896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:03.881657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:03.889278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:03.890759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-56950fee-4994-4865-b6ce-03286330722c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1341 microversion: 2.20 time: 0.224705 Dec 02 15:49:03.891559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 49/92] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:03 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:04.178572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:04.190046 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ecc02ff7-31aa-44c1-bdee-5480b1c130fd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.916092 Dec 02 15:49:04.191168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 44/93] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:03 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:04.688217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:04.688881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:04.698091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:04.699115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:04.700698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:04.700975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:04.920420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:04.922086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:04.938158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:04.939068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:04.940697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:04.941857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:05.317627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:05.347511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:05.366840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:05.368072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-66150161-d03c-400a-af26-82449420532a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.459818 Dec 02 15:49:05.368648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 45/94] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:04 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:05.424851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:05.425662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:05.437802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:05.438231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:05.439605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:05.440300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:05.785088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:05.810562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c29c83f7-80b1-413e-a769-665b7c603e8f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.437306 Dec 02 15:49:05.811153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 46/95] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:05 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:05.867288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:05.894207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1f094d70-d861-4f4a-989a-ac9c1957f35b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1326 microversion: 2.1 time: 1.215097 Dec 02 15:49:05.907027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 50/96] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:04 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1326 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:06.337037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-6a170603-d489-4894-8e09-75bfe1e11250 req-91db961f-013b-4717-842f-e295d52c873a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b113cf-44c3-41ee-abfd-329c10e9e8e7", "tag": "6c5618f4-d019-4723-9ad0-1720cd93ca07"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:06.345133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:06.345133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:06.355587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-6a170603-d489-4894-8e09-75bfe1e11250 req-91db961f-013b-4717-842f-e295d52c873a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:06.356600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-6a170603-d489-4894-8e09-75bfe1e11250 req-91db961f-013b-4717-842f-e295d52c873a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:06.378701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-6a170603-d489-4894-8e09-75bfe1e11250 req-91db961f-013b-4717-842f-e295d52c873a service nova] Creating event network-changed:6c5618f4-d019-4723-9ad0-1720cd93ca07 for instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 on hv-cinder-73761 Dec 02 15:49:06.385537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-6a170603-d489-4894-8e09-75bfe1e11250 req-91db961f-013b-4717-842f-e295d52c873a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065021 Dec 02 15:49:06.386689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 47/97] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:06 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:49:06.402295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:06.403202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:06.412294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:06.413242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:06.414305 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:06.415650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:06.836046 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:06.837113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:06.846248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:06.847005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:06.848105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:06.848772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:07.106413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:07.121505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-04c8185f-fbf2-493b-852e-9736698ed569 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.295924 Dec 02 15:49:07.122131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 48/98] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:06 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:07.151346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:07.152104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:07.164064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:07.164578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:07.165424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:07.166042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:07.469619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:07.505776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:07.518827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:07.528423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:07.531517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a9569fcb-afe1-41d8-a331-571ffff4be6f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 1.142280 Dec 02 15:49:07.534448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 51/99] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:06 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:49:07.543314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d1c1a2fe-82e4-4d62-ab39-8d5508df08a4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1520 microversion: 2.1 time: 0.420065 Dec 02 15:49:07.544240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 49/100] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:07 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:07.575143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:07.577122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:07.587345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:07.587925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:07.588809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:07.589638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:07.664667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lazy-loading 'flavor' on Instance uuid 62b68ba3-ad18-47ee-80c0-8282bdd3368b {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:49:08.022114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8d8dfd6a-746f-4ac4-a0f5-5db44a6e8839 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b/action" status: 200 len: 32 microversion: 2.1 time: 0.457744 Dec 02 15:49:08.023561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 52/101] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:07 2020] POST /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:08.038893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:08.039569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:08.051465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:08.054710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:08.055635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:08.056171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:08.164456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:08.173451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:08.194822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:08.198166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:08.199234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:08.201780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:08.613076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:08.624149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-13d55cd3-af67-42d0-bca8-00e4bdae64a2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.594686 Dec 02 15:49:08.625140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 50/102] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:08 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:08.639483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-424701941", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "0e8d58a1-9518-45ad-8e30-37b570122f7b"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:08.791136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] validate_networks() for [('0e8d58a1-9518-45ad-8e30-37b570122f7b', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:49:09.374424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:09.388349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e1e967ff-8003-479e-a76c-b71787fbd2f6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 1.250832 Dec 02 15:49:09.399734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 53/103] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:08 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:09.414081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:09.416277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:09.427490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:09.428392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:09.429436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:09.430598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.239573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:49:10.240079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:49:10.240766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:49:10.241229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:49:10.241729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:49:10.250915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.251493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.252521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.253015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.272684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:49:10.277009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for user 792f7ff55fec492a8cf35f9e27c85210 and project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:49:10.289163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:49:10.291751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:49:10.334377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:10.350946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:10.358111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:10.359299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e09774d6-7c59-4941-a8ab-21b3d902aca7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.958111 Dec 02 15:49:10.360121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 54/104] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:09 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:10.379123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-c708012a-1fec-4848-889e-dfffe25b0f05 req-9f9d310c-aa70-4b22-b8de-e7692bb41a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:10.387365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:10.387365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:10.397978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-c708012a-1fec-4848-889e-dfffe25b0f05 req-9f9d310c-aa70-4b22-b8de-e7692bb41a99 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.397978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-c708012a-1fec-4848-889e-dfffe25b0f05 req-9f9d310c-aa70-4b22-b8de-e7692bb41a99 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.416577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-c708012a-1fec-4848-889e-dfffe25b0f05 req-9f9d310c-aa70-4b22-b8de-e7692bb41a99 service nova] Creating event network-changed:f1a284ff-0f4c-48d6-b0e8-b35db079365a for instance a5112b52-9227-41cf-a36c-19e97dd4222c on hv-cinder-73761 Dec 02 15:49:10.421841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-c708012a-1fec-4848-889e-dfffe25b0f05 req-9f9d310c-aa70-4b22-b8de-e7692bb41a99 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056524 Dec 02 15:49:10.422684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 55/105] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:10 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:10.433526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:10.434292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:10.443354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.443647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.444529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.445130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.481924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c3be9709-f954-417e-adeb-dbfa2f3d725d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.853519 Dec 02 15:49:10.482856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 51/106] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:49:08 2020] POST /compute/v2.1/servers => generated 382 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:49:10.496410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:10.497575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:10.518534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.519279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.520475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:10.521043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:10.899814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:10.922113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e65bce06-9267-4e3c-9e51-7ef3d9bb9238 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.498067 Dec 02 15:49:10.922727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 56/107] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:10 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:10.947866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-09c5de62-23b7-48b0-a91e-dedacf7d595c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:10.949294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-09c5de62-23b7-48b0-a91e-dedacf7d595c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:10.981612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:11.006150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4f920df1-da92-45be-9b0d-0028a761d38b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.521703 Dec 02 15:49:11.007381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 52/108] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:10 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:11.099759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-09c5de62-23b7-48b0-a91e-dedacf7d595c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:11.111492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-09c5de62-23b7-48b0-a91e-dedacf7d595c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1221 microversion: 2.1 time: 0.177058 Dec 02 15:49:11.124150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 57/109] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:10 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:11.385634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:11.386915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:11.397862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:11.398381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:11.399276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:11.399772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:11.696898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:11.712852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:11.720323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:11.721860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-100b8e9f-d741-42ed-925c-3b67ed3966cc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.347348 Dec 02 15:49:11.733605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 53/110] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:11 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:11.947263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:11.948188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:11.979941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:11.984184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:11.985346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:11.986066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:12.061303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:12.061950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:12.071624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:12.072410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:12.073413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:12.074049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:12.481396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:12.493434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-97963d2a-0651-4690-bd9f-5d157a850802 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.450703 Dec 02 15:49:12.494589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 54/111] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:12 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:12.505982 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:12.506882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:12.515657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:12.516505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:12.518346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:12.519181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:12.563854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:12.574121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-36525b06-12d0-4a67-a644-44f4f997b422 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.637941 Dec 02 15:49:12.575304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 58/112] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:11 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:12.684325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:12.693566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3eaf19d6-820c-4d82-9a7c-77902e615d5c tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1273 microversion: 2.1 time: 0.197652 Dec 02 15:49:12.694455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 55/113] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:12 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:12.747446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:12.750667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:12.768265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:12.770797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:12.772890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:12.776718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:13.364452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:13.390054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:13.398705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:13.399294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-58da2f41-073e-40ca-8225-969eef76d184 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.661937 Dec 02 15:49:13.399951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 59/114] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:12 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:13.520090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:13.520735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:13.529098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:13.529984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:13.530967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:13.531664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:13.599072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:13.606414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:13.644654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:13.644654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:13.644654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:13.644654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:14.013482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:14.028561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-27e4b69b-35f0-4ba3-909e-e2ebb36310cd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.518646 Dec 02 15:49:14.030073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 56/115] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:13 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:14.049144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:14.050126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:14.060468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:14.061308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:14.062521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:14.063156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:14.146612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:14.160170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cb85976c-8c56-45b9-93ce-9ced93b3492c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.571208 Dec 02 15:49:14.161042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 60/116] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:13 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:14.230512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:14.240359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f30d5f33-96ea-44e0-86ba-1942af16a305 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1279 microversion: 2.1 time: 0.208744 Dec 02 15:49:14.256266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 57/117] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:14 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:14.425698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:14.426379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:14.434629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:14.435131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:14.435967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:14.436465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:14.852561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:14.870123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:14.880284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:14.881483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d339fe85-35d4-4aae-80c6-72c7050470b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.466578 Dec 02 15:49:14.904177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 61/118] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:14 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:49:14.928666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-993575ac-d437-4117-a80c-f712853cda72 req-2a627e3f-b3d6-45dd-989b-47187f9138ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b113cf-44c3-41ee-abfd-329c10e9e8e7", "name": "network-vif-plugged", "status": "completed", "tag": "6c5618f4-d019-4723-9ad0-1720cd93ca07"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:14.936421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:14.936421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:14.946462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-993575ac-d437-4117-a80c-f712853cda72 req-2a627e3f-b3d6-45dd-989b-47187f9138ca service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:14.947287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-993575ac-d437-4117-a80c-f712853cda72 req-2a627e3f-b3d6-45dd-989b-47187f9138ca service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:14.980199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-993575ac-d437-4117-a80c-f712853cda72 req-2a627e3f-b3d6-45dd-989b-47187f9138ca service nova] Creating event network-vif-plugged:6c5618f4-d019-4723-9ad0-1720cd93ca07 for instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 on hv-cinder-73761 Dec 02 15:49:14.994078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-993575ac-d437-4117-a80c-f712853cda72 req-2a627e3f-b3d6-45dd-989b-47187f9138ca service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076360 Dec 02 15:49:14.995365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 58/119] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:14 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:15.068786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:15.068786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:15.086027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:15.087046 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:15.088105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:15.088745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:15.213897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:15.216704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:15.240020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:15.242881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:15.245167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:15.246897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:15.567456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:15.586968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ac947850-5759-4eba-b450-b3fcd5541107 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.536227 Dec 02 15:49:15.601429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 62/120] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:15 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:15.628645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:15.629642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:15.651007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:15.653299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:15.659029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:15.660021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:15.983136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:15.995950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b8f95d7f-a15d-46ad-866b-f3280255f05d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.814668 Dec 02 15:49:16.012001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 59/121] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:15 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:16.036808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:16.038105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:16.054092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:16.055394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:16.057075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:16.058006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:16.588293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:16.627205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:16.637494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:16.638952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-462d6706-4be5-4468-bc3c-305734dd00e3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.625145 Dec 02 15:49:16.639661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 60/122] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:16 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:16.660864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:16.661583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:16.670013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:16.670536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:16.671561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:16.672076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:16.720779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:16.732263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cabaa318-08fc-4d3a-b5cf-b64401775aa6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 1.127264 Dec 02 15:49:16.732849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 63/123] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:15 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:16.755197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:16.755865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:16.761791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:49:16.766549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:16.766549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:16.766549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:16.766549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.195170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-85948a1f-c1fe-434b-93f4-6ae9ce169278 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "DELETE /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 204 len: 0 microversion: 2.1 time: 0.542525 Dec 02 15:49:17.195170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 61/124] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:49:16 2020] DELETE /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 0 bytes in 549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:49:17.207763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:17.208604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:17.237961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.238709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.240176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.241526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.390307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:17.418430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-11206140-ae6d-462f-9438-1eddc5be962b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.672580 Dec 02 15:49:17.419561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 64/125] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:16 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:17.451550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:17.452675 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:17.480102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.480612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.483240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.483748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.612523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:17.623115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ac9ec1b4-5083-44b9-be31-7d1e9fbe0585 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.432230 Dec 02 15:49:17.623758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 62/126] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:17 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:17.669337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:17.673698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:17.687335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.687696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.688690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.689430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:17.937774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:17.960005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:17.969089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:17.972194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-35f8d23e-7588-4912-be54-6af7e03c9d67 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 0.549054 Dec 02 15:49:17.973045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 65/127] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:17 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:17.976746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:17.977925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-30116513-166f-460a-9c01-84c956ad7c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.323391 Dec 02 15:49:17.978536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 63/128] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:17 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:49:17.989236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:17.989907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:17.998714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:17.999216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.000137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:18.000631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.011831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-6a36232c-e420-447d-ae41-2c42f501948a req-5cbc39f4-5cb5-47b5-97f1-cc4f136c74e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bc7128f-2441-4c19-8fab-86f5b2239e56", "tag": "0fc63adc-a95c-4e8b-bc36-37690089fe6e"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:18.019497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:18.019497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:18.030910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-6a36232c-e420-447d-ae41-2c42f501948a req-5cbc39f4-5cb5-47b5-97f1-cc4f136c74e4 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:18.031771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-6a36232c-e420-447d-ae41-2c42f501948a req-5cbc39f4-5cb5-47b5-97f1-cc4f136c74e4 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.053371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-6a36232c-e420-447d-ae41-2c42f501948a req-5cbc39f4-5cb5-47b5-97f1-cc4f136c74e4 service nova] Creating event network-changed:0fc63adc-a95c-4e8b-bc36-37690089fe6e for instance 2bc7128f-2441-4c19-8fab-86f5b2239e56 on hv-cinder-73761 Dec 02 15:49:18.058794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-6a36232c-e420-447d-ae41-2c42f501948a req-5cbc39f4-5cb5-47b5-97f1-cc4f136c74e4 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056161 Dec 02 15:49:18.070201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 64/129] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:18 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:49:18.264599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:18.281979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0d3a1701-9851-4529-9439-7dc5c9db4125 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.307558 Dec 02 15:49:18.283448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 66/130] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:17 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:18.453178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:18.453943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:18.462960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:18.463463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.464317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:18.464796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.647386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:18.648086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:18.656369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:18.656875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.657789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:18.658443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:18.691442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:18.700600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fbea7958-6d08-447f-9893-a1aae3bf4c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.257062 Dec 02 15:49:18.701213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 65/131] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:18 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:18.886940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:18.895862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1338c9e0-af96-4533-b8f1-0a1cc7367617 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.257618 Dec 02 15:49:18.896477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 67/132] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:18 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:18.996840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:18.997517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:19.002630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:19.003312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:19.005752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.006267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.007132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.007628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.011403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.011908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.012776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.013268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.248958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:19.261133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:19.264382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:19.271400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-67cf42c9-89a4-4ea6-8783-d463bfe679ec tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 0.285070 Dec 02 15:49:19.271928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:19.272082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 66/133] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:18 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:19.273074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-93203832-079b-4a1d-8732-6ce81a9e7070 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.279791 Dec 02 15:49:19.273644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 68/134] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:18 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:19.305456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:19.306188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:19.314240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.314893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.315903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.316353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.545608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:19.554643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f988f82a-c0f4-4a7a-91d2-f507225fc48e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.258887 Dec 02 15:49:19.555244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 67/135] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:19 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:19.724300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:19.726828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:19.733949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.734585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.735579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.736327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.920312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:19.920994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:19.930173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.930604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:19.931743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:19.932029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.188755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:20.199211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-071105e4-fdff-48e5-9853-51f554177761 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.288579 Dec 02 15:49:20.208112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 68/136] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:19 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:20.219049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:20.229338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-55f6fbc0-8c3f-4303-8507-35f0e1aebcf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1364 microversion: 2.1 time: 0.514836 Dec 02 15:49:20.247911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 69/137] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:19 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1364 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:20.297970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:20.299363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:20.299992 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:20.300455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:20.310846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.312790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.312790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.312981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.317125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.317934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.319351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.320052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.677923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:20.688256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4d71aa18-9413-4855-a445-6798b37ef70e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 0.401784 Dec 02 15:49:20.699462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 69/138] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:20 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:20.700007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-5099b2e4-c9ac-4b87-b8a8-ed5f14b169a3 req-091ddae9-9ecb-49bb-a1a8-9c353842f6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "name": "network-vif-plugged", "status": "completed", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:20.707321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:20.707321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:20.717033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5099b2e4-c9ac-4b87-b8a8-ed5f14b169a3 req-091ddae9-9ecb-49bb-a1a8-9c353842f6fa service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.717533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5099b2e4-c9ac-4b87-b8a8-ed5f14b169a3 req-091ddae9-9ecb-49bb-a1a8-9c353842f6fa service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.737902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-5099b2e4-c9ac-4b87-b8a8-ed5f14b169a3 req-091ddae9-9ecb-49bb-a1a8-9c353842f6fa service nova] Creating event network-vif-plugged:f1a284ff-0f4c-48d6-b0e8-b35db079365a for instance a5112b52-9227-41cf-a36c-19e97dd4222c on hv-cinder-73761 Dec 02 15:49:20.745756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-5099b2e4-c9ac-4b87-b8a8-ed5f14b169a3 req-091ddae9-9ecb-49bb-a1a8-9c353842f6fa service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055279 Dec 02 15:49:20.748872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 70/139] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:20.761628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:20.762728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:20.771871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.772720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.773687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:20.774467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:20.852414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:20.873254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:20.882901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:20.885997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-10d4ab16-ec79-4df7-9f6f-8d7722d1d1ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.596879 Dec 02 15:49:20.887282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 70/140] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:20 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:20.921856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-578539199", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "ff174474-e4b7-43a0-9a9f-af048d26f968"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:21.028709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] validate_networks() for [('ff174474-e4b7-43a0-9a9f-af048d26f968', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:49:21.352857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:21.363571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5cf74096-f976-4100-abfb-886d4d07e63e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.613375 Dec 02 15:49:21.364578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 71/141] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:20 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:21.378356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:21.379659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:21.390360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:21.391273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:21.392938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:21.393849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:21.646352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:21.660604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0a51c68a-e7f6-43f6-9394-eb6bb3eee303 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.294522 Dec 02 15:49:21.661751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 72/142] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:21 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:21.673375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:21.674884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:21.699286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:21.699904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:21.701708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:21.701708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:21.939531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:21.948653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4a748309-c79e-4566-8ff2-a60fc921659b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1550 microversion: 2.1 time: 0.285683 Dec 02 15:49:21.955818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 73/143] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:21 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1550 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:21.960364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:21.961032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:21.970163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:21.970741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:21.971592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:21.972110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.095605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:49:22.096431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:49:22.096984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:49:22.097448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:49:22.097913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:49:22.106971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.107484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.108396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.109042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.129606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Getting quotas for project 56c9112430664980ab7f1093238878e5. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:49:22.133937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Getting quotas for user c69aacc8110b4aaf93aaebe8d1ce6fa4 and project 56c9112430664980ab7f1093238878e5. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:49:22.146453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:49:22.149193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:49:22.210696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:22.220739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-81cf830e-805a-405d-b423-d0839c7abbd7 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 0.270294 Dec 02 15:49:22.231604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 74/144] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:21 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:22.231777 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:22.232526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:22.239568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d17de552-5d11-4dbb-838b-6fb9cfb15e8c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.350381 Dec 02 15:49:22.241292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 71/145] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:49:20 2020] POST /compute/v2.1/servers => generated 382 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:49:22.242397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.242898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.243734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.244278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.253368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:22.253924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:22.262922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.263437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.264376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.264884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.452523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dab67587-3084-4ae1-9615-53083e34fe6d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209717 Dec 02 15:49:22.459270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 72/146] 10.222.0.101 () {58 vars in 1270 bytes} [Wed Dec 2 15:49:22 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:22.464552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ec04e6db-7493-4018-a242-2dd2a6bc0940 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:22.465699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ec04e6db-7493-4018-a242-2dd2a6bc0940 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:22.510100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:22.525645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:22.532618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:22.535437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-20cc19be-20e0-4fd6-96a2-fed94c7e2bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.311317 Dec 02 15:49:22.537319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 75/147] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:22 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:22.550894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:22.552062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:22.560622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.561116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.562007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.562588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.594981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ec04e6db-7493-4018-a242-2dd2a6bc0940 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:22.606601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ec04e6db-7493-4018-a242-2dd2a6bc0940 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1217 microversion: 2.1 time: 0.152183 Dec 02 15:49:22.609459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 73/148] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:22 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:22.685232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:22.686151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:22.699701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.700234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.701087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:22.701575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:22.904374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:22.916093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8618ea40-9903-48a9-a731-025257b1bdf5 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.377104 Dec 02 15:49:22.916889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 76/149] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:22 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:23.245536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:23.246212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:23.255994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.256451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.257316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.257809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.288268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:23.300495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-951591db-f95f-4a62-8064-a21c495bea70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.625191 Dec 02 15:49:23.312625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 74/150] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:22 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:23.507299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:23.518141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2987e0c3-6953-414c-8a14-cda2d1aaa49e tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 0.282845 Dec 02 15:49:23.518783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 77/151] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:23 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:23.562151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:23.562832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:23.578791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.579318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.580340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.581122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.634717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:23.635473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:23.644142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.644657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.645520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.646716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.801788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:23.812637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-18082b71-916d-4fa3-8d03-1a4cf4728fd0 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1213 microversion: 2.1 time: 0.190172 Dec 02 15:49:23.813677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 78/152] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:23 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:23.948409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:23.949249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:23.964487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.965003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:23.965967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:23.974479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:24.283381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:24.302898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8f38f352-4181-451d-836c-359768ce296b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.369364 Dec 02 15:49:24.303707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 79/153] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:23 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:24.317602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:24.327608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:24.328766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:24.339021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:24.339700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:24.340724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:24.341581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:24.342370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:24.352730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:24.355620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a26cc1c5-7fe5-46a9-bd5a-5b0dc0abaffb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1409 microversion: 2.20 time: 0.803393 Dec 02 15:49:24.357281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 75/154] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:23 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1409 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:24.548486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:24.549641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:24.559559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:24.560134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:24.560935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:24.561431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:24.622418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:24.636165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1ae789a8-6333-4751-b9b1-f45ad18b1e9a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.319019 Dec 02 15:49:24.637913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 80/155] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:24 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:24.842444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:24.843246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:24.854168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:24.854681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:24.855566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:24.856096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:25.033965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:25.054283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6d0674db-ca8d-47dd-93cf-0d8b99ee944f tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1269 microversion: 2.1 time: 0.222433 Dec 02 15:49:25.055126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 81/156] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:24 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:25.333559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:25.334242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:25.343496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:25.344028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:25.345267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:25.346079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:25.605466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:25.618208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ca33a41b-e6dd-4601-ada9-db928424af91 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 1.085443 Dec 02 15:49:25.620128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 76/157] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:24 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:25.646877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:25.647900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:25.657829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:25.658715 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:25.659419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:25.660500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:25.661181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:25.667190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f85018e8-1787-46fa-b2df-50542b4c1c16 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.348199 Dec 02 15:49:25.672048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 82/158] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:25 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:25.686688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:25.687656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:25.706278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:25.706859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:25.707733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:25.708280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.002772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:26.012805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-801f1ba1-ff27-4d37-8f6d-91d849621955 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.343521 Dec 02 15:49:26.013442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 83/159] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:25 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:26.025249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-5174b68b-cdaf-4159-b7e6-410ae4847313 req-1d36340b-e212-46d3-9862-5ec64508cd2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd7e98-e386-4d4c-8795-01ea862e34ee", "name": "network-vif-unplugged", "status": "completed", "tag": "10125ed7-437d-4e72-b3b3-ee3b47b41c2f"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:26.032537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:26.032537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:26.043319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5174b68b-cdaf-4159-b7e6-410ae4847313 req-1d36340b-e212-46d3-9862-5ec64508cd2b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.043828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5174b68b-cdaf-4159-b7e6-410ae4847313 req-1d36340b-e212-46d3-9862-5ec64508cd2b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.067462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-5174b68b-cdaf-4159-b7e6-410ae4847313 req-1d36340b-e212-46d3-9862-5ec64508cd2b service nova] Creating event network-vif-unplugged:10125ed7-437d-4e72-b3b3-ee3b47b41c2f for instance 01fd7e98-e386-4d4c-8795-01ea862e34ee on hv-cinder-73761 Dec 02 15:49:26.073406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-5174b68b-cdaf-4159-b7e6-410ae4847313 req-1d36340b-e212-46d3-9862-5ec64508cd2b service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058447 Dec 02 15:49:26.073971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 84/160] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:26 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:26.091959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:26.092914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:26.103472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.104017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.104967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.105460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.255930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:26.265206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e74f615c-56aa-4ae5-a4c0-84cdd6040664 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1275 microversion: 2.1 time: 0.189918 Dec 02 15:49:26.265816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 85/161] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:26 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1275 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:26.645310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:26.646156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:26.654608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.655085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.655931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.656444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.945837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:26.965733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-026b9525-de10-4b6d-99dc-160a0536944b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 0.329036 Dec 02 15:49:26.968942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 86/162] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:26 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:26.982615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:26.983677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:26.993889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.994391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:26.995256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:26.995836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.219021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:27.243256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:27.254250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:27.255757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bf34003f-b9dc-4100-94bd-42a04ec791b6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1601 microversion: 2.20 time: 1.622069 Dec 02 15:49:27.256455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 77/163] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:49:25 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1601 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:27.270730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:27.271696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:27.284108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.284641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.285512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.286084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.291629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:27.303109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3d9b1db8-9405-4dac-831b-638d3c70df78 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.332057 Dec 02 15:49:27.304218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 87/164] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:26 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:27.317252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:27.318174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:27.326826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.327319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.328338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.328930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.547671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-33802257-f41f-451d-851b-98fb292ff318 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.241157 Dec 02 15:49:27.552567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 88/165] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:27 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:27.598872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-cd46a63d-71a4-433d-bf78-b287e1b3fdce req-128d79ce-3593-4f37-a077-4f4aad47baee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b113cf-44c3-41ee-abfd-329c10e9e8e7", "tag": "6c5618f4-d019-4723-9ad0-1720cd93ca07"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:27.615504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:27.615504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:27.635796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-cd46a63d-71a4-433d-bf78-b287e1b3fdce req-128d79ce-3593-4f37-a077-4f4aad47baee service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.636827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-cd46a63d-71a4-433d-bf78-b287e1b3fdce req-128d79ce-3593-4f37-a077-4f4aad47baee service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.664576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-cd46a63d-71a4-433d-bf78-b287e1b3fdce req-128d79ce-3593-4f37-a077-4f4aad47baee service nova] Creating event network-changed:6c5618f4-d019-4723-9ad0-1720cd93ca07 for instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 on hv-cinder-73761 Dec 02 15:49:27.671951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-cd46a63d-71a4-433d-bf78-b287e1b3fdce req-128d79ce-3593-4f37-a077-4f4aad47baee service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119399 Dec 02 15:49:27.673006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 89/166] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:27 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:27.699429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:27.700105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:27.711229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.711730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.719249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.719846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.896800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:27.910003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-35f5e8d3-a54c-42c7-8a4d-83a5fe7562b0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.651716 Dec 02 15:49:27.911463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 78/167] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:27 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:27.926100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:27.927186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:27.952944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.953627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:27.955449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:27.956216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:28.290639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-02c15697-5160-4e2a-91f5-275157a70fde tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.613668 Dec 02 15:49:28.292614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 90/168] 10.222.0.101 () {60 vars in 1311 bytes} [Wed Dec 2 15:49:27 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-interface => generated 284 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:28.357388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:28.358981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:28.393544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:28.397495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:28.406766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:28.406766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:28.705211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:28.731354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ce48bb56-7e04-4f88-996d-a71409804376 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1275 microversion: 2.1 time: 0.817933 Dec 02 15:49:28.741762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 79/169] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:27 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1275 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:28.766663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:28.769319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:28.789574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:28.793205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:28.794308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:28.794860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:29.631836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:29.646311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fe998e38-c4a9-4a5f-ab93-b91538175a9d tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1556 microversion: 2.1 time: 1.339643 Dec 02 15:49:29.647207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 91/170] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:28 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1556 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:29.658274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:29.659340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:29.674779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:29.675788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:29.676694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:29.677307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:29.840004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-95660b99-a711-4d29-9340-83c02b85cd45 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.190826 Dec 02 15:49:29.841029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 92/171] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:29 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:29.863102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-7baef598-eb03-4e15-a7f9-f1c39a703e0e req-f156f044-bdef-4817-a583-3bb8af27cbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc7128f-2441-4c19-8fab-86f5b2239e56", "name": "network-vif-plugged", "status": "completed", "tag": "0fc63adc-a95c-4e8b-bc36-37690089fe6e"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:29.871220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:29.871220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:29.887435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-7baef598-eb03-4e15-a7f9-f1c39a703e0e req-f156f044-bdef-4817-a583-3bb8af27cbc5 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:29.888260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-7baef598-eb03-4e15-a7f9-f1c39a703e0e req-f156f044-bdef-4817-a583-3bb8af27cbc5 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:29.928763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-7baef598-eb03-4e15-a7f9-f1c39a703e0e req-f156f044-bdef-4817-a583-3bb8af27cbc5 service nova] Creating event network-vif-plugged:0fc63adc-a95c-4e8b-bc36-37690089fe6e for instance 2bc7128f-2441-4c19-8fab-86f5b2239e56 on hv-cinder-73761 Dec 02 15:49:29.935066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-7baef598-eb03-4e15-a7f9-f1c39a703e0e req-f156f044-bdef-4817-a583-3bb8af27cbc5 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085709 Dec 02 15:49:29.936084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 93/172] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:29 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:29.949955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:29.951182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:29.960978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:29.962053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:29.962676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:29.963248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:30.071930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:30.105066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f165d838-701d-4086-a0f4-804423d477cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 1.359809 Dec 02 15:49:30.116281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 80/173] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:28 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:30.148595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:30.149280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:30.169697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:30.170600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:30.171603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:30.172287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:30.928698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:30.954074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-06602ec1-ec31-46fa-89e3-b1b0425352ce tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 1.012456 Dec 02 15:49:30.954074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 94/174] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:29 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:30.999734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:31.003039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:31.022852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.023696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.026794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.027562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.116050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:31.165138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5dfbad83-f694-4661-a5d0-b48da669ae56 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 1.046966 Dec 02 15:49:31.170668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 81/175] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:30 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:31.214534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:31.219548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:31.255464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.256323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.257519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.258492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.395813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:31.406829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-644b4c9e-db84-4a3d-97eb-ddb2a2172516 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1514 microversion: 2.1 time: 0.435029 Dec 02 15:49:31.420319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 95/176] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:30 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:31.434638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ba3738bb-7def-43a8-9e9a-cac7fb768fb4 req-a32cf090-2ffb-40a8-855a-a264d6cabe61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd7e98-e386-4d4c-8795-01ea862e34ee", "name": "network-vif-deleted", "tag": "10125ed7-437d-4e72-b3b3-ee3b47b41c2f"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:31.444273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:31.444273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:31.459366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4ea0fc46-6e1e-4a92-a0f2-d863be3ca5e9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.286398 Dec 02 15:49:31.460395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 82/177] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:31 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:31.460645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ba3738bb-7def-43a8-9e9a-cac7fb768fb4 req-a32cf090-2ffb-40a8-855a-a264d6cabe61 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.461289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ba3738bb-7def-43a8-9e9a-cac7fb768fb4 req-a32cf090-2ffb-40a8-855a-a264d6cabe61 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.476108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:31.477402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:31.490155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.491093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.491338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ba3738bb-7def-43a8-9e9a-cac7fb768fb4 req-a32cf090-2ffb-40a8-855a-a264d6cabe61 service nova] Creating event network-vif-deleted:10125ed7-437d-4e72-b3b3-ee3b47b41c2f for instance 01fd7e98-e386-4d4c-8795-01ea862e34ee on hv-cinder-73761 Dec 02 15:49:31.493019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:31.494146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:31.502650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ba3738bb-7def-43a8-9e9a-cac7fb768fb4 req-a32cf090-2ffb-40a8-855a-a264d6cabe61 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080348 Dec 02 15:49:31.518242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 96/178] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:31 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:31.970811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:31.980887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a62bcf61-37cd-41da-9e9d-5f9479cafeca tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1321 microversion: 2.1 time: 0.518725 Dec 02 15:49:31.981600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 83/179] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:31 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:32.019950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:32.020768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:32.029273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.029780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.030832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.031183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.092328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:32.098797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:32.135468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.138934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.140008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.140647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.501884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d8dec64a-ce0b-4710-8841-7483fd3bdd57 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.427141 Dec 02 15:49:32.503266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 84/180] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:32 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:32.518130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-87ae56b9-76ab-4278-8c4b-6712985efbde req-4bb6d585-ea49-44cb-8086-a58b6a1b380b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:32.526444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:32.526444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:32.543127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-87ae56b9-76ab-4278-8c4b-6712985efbde req-4bb6d585-ea49-44cb-8086-a58b6a1b380b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.543956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-87ae56b9-76ab-4278-8c4b-6712985efbde req-4bb6d585-ea49-44cb-8086-a58b6a1b380b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.565495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:32.567418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-87ae56b9-76ab-4278-8c4b-6712985efbde req-4bb6d585-ea49-44cb-8086-a58b6a1b380b service nova] Creating event network-changed:f1a284ff-0f4c-48d6-b0e8-b35db079365a for instance a5112b52-9227-41cf-a36c-19e97dd4222c on hv-cinder-73761 Dec 02 15:49:32.574955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-87ae56b9-76ab-4278-8c4b-6712985efbde req-4bb6d585-ea49-44cb-8086-a58b6a1b380b service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069236 Dec 02 15:49:32.576579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 85/181] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:32 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:32.589223 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8e7ee283-2d4f-433d-b153-1179daabafc9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.604444 Dec 02 15:49:32.589842 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 97/182] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:31 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:32.592474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:32.593396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:32.603966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.604747 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.605737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.606368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.620529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:32.621217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:32.642106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.645598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.646427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.653319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.784180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:32.785135 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:32.785648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lazy-loading 'fault' on Instance uuid 01fd7e98-e386-4d4c-8795-01ea862e34ee {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:49:32.893117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbbde01a5d114cd598c87133e11599ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa8264f106340e3bae2ec60311e66f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:32.929264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c11423d-d768-4330-835c-b1ee326aec6b tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 200 len: 1354 microversion: 2.1 time: 0.327011 Dec 02 15:49:32.930443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 98/183] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:32 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 1354 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:32.980157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:32.982068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:33.000987 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.001989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.003544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.005367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.194020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-016554e8-393e-4e05-a668-b9bb79d645fb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.245317 Dec 02 15:49:33.194718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 99/184] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:32 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:33.212556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:33.213345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:33.224021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.224545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.225522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.226024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.333641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:33.353899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dd515bff-043a-4eba-ac28-cd43346ad626 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.775775 Dec 02 15:49:33.361130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 86/185] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:32 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:33.526757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:33.531559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:33.532224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:33.543469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5e508445-17a4-4e2c-b905-5ea6213385f9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1511 microversion: 2.1 time: 0.347376 Dec 02 15:49:33.544451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 100/186] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:33 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1511 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:33.552955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.557776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.559553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.560081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.573994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9e2b83c-3ed5-4a2b-9849-328840203604"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:33.585153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:33.600800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.601962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.609144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.609936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.800555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4033ac18-4a9d-470a-acc1-ff1ce7a29243 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.288513 Dec 02 15:49:33.801573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 87/187] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:33 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:33.822951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:33.824284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:33.837432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.838389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:33.839502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:33.840224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.334366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:34.358128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dc209e0b-8b89-409f-bca8-aa1ecf5ac25a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.554859 Dec 02 15:49:34.358731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 88/188] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:33 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:34.369489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:34.370231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:34.378596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.379346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.380380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.381036 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.453093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] HTTP exception thrown: Instance 01fd7e98-e386-4d4c-8795-01ea862e34ee could not be found. Dec 02 15:49:34.453864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Returning 404 to user: Instance 01fd7e98-e386-4d4c-8795-01ea862e34ee could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:49:34.455176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6d2e930a-8cd1-4f1b-83a0-3689f181d587 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 404 len: 111 microversion: 2.1 time: 0.095124 Dec 02 15:49:34.455744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 89/189] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:34 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:49:34.469257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-b2ccaa3d-f9b8-4418-885e-7e5e3bd6b973 req-4fb02ecb-9542-42ec-9a68-f832817f2a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00d2cade-ff55-4d31-9cbd-8b9575d38b52", "tag": "6ca07d1b-88a8-4b33-89ea-6b80adb12fa7"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:34.480971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:34.480971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:34.491364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b2ccaa3d-f9b8-4418-885e-7e5e3bd6b973 req-4fb02ecb-9542-42ec-9a68-f832817f2a67 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.491870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b2ccaa3d-f9b8-4418-885e-7e5e3bd6b973 req-4fb02ecb-9542-42ec-9a68-f832817f2a67 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.522557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-b2ccaa3d-f9b8-4418-885e-7e5e3bd6b973 req-4fb02ecb-9542-42ec-9a68-f832817f2a67 service nova] Creating event network-changed:6ca07d1b-88a8-4b33-89ea-6b80adb12fa7 for instance 00d2cade-ff55-4d31-9cbd-8b9575d38b52 on hv-cinder-73761 Dec 02 15:49:34.529455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-b2ccaa3d-f9b8-4418-885e-7e5e3bd6b973 req-4fb02ecb-9542-42ec-9a68-f832817f2a67 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072361 Dec 02 15:49:34.530488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 90/190] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:34 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:34.545334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:34.546686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:34.555779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.556636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.557648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.558294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.605264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] HTTP exception thrown: Invalid input received: Invalid volume: Volume c9e2b83c-3ed5-4a2b-9849-328840203604 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-e5c2c4b3-3d4a-407f-b794-8f0efc44e12e) Dec 02 15:49:34.606122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Returning 400 to user: Invalid input received: Invalid volume: Volume c9e2b83c-3ed5-4a2b-9849-328840203604 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-e5c2c4b3-3d4a-407f-b794-8f0efc44e12e) {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:49:34.607060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d7614ee8-f45c-4a75-8ab7-f25b07d9bd1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56/os-volume_attachments" status: 400 len: 279 microversion: 2.1 time: 1.049236 Dec 02 15:49:34.607716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 101/191] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:49:33 2020] POST /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56/os-volume_attachments => generated 279 bytes in 1051 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 02 15:49:34.636240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:34.637142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:34.657641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.658469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.661329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.661329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.773111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-479ac516-740f-433a-8935-3848a3d2caf8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.240852 Dec 02 15:49:34.777744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 91/192] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:34 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:34.825875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:34.827255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:34.844771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.853828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:34.855021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:34.855558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.089887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:35.116775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-47e398fd-1856-4d8b-b977-df639dbc2d89 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.499400 Dec 02 15:49:35.118095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 102/193] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:34 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:35.136716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af13623f-1985-4a5e-854c-d1a2f4eed94a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.328397 Dec 02 15:49:35.137985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 92/194] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:34 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:35.146018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:35.146571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:35.159734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:35.160551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.161566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:35.162206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.384487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:35.386344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:35.396855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:35.397586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.398967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:35.399793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.722853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-40ffa4da-5b15-4050-a9e4-39173c5bed17 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e/os-volume_attachments/c9e2b83c-3ed5-4a2b-9849-328840203604" status: 202 len: 0 microversion: 2.1 time: 0.593107 Dec 02 15:49:35.727088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 103/195] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:49:35 2020] DELETE /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e/os-volume_attachments/c9e2b83c-3ed5-4a2b-9849-328840203604 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:49:35.797473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:35.798769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:35.807320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:35.807819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.810461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:35.811401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:35.853126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:35.862292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9946c45a-ca8e-4a48-be83-686a3dcc2514 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.488336 Dec 02 15:49:35.862892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 93/196] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:35 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:36.082566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ab6604c3-3af2-4284-a71d-77cda3d2452c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.300770 Dec 02 15:49:36.086943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 104/197] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:35 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:36.147119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:36.147906 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:36.156166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:36.156302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.156837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.157304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:36.158062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.158813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.166385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.169262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.169262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.169262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.397397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-03c7f7d3-2437-4baa-aa7a-9c4f262cd22e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.251305 Dec 02 15:49:36.398106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 105/198] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:36 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:36.585407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:36.612789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c5400de1-a7b4-4392-a409-781612518a96 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.460132 Dec 02 15:49:36.612789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 94/199] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:36 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:36.786986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:36.787631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:36.796383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.796883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.798228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.798733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.858744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] HTTP exception thrown: Instance 01fd7e98-e386-4d4c-8795-01ea862e34ee could not be found. Dec 02 15:49:36.859412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Returning 404 to user: Instance 01fd7e98-e386-4d4c-8795-01ea862e34ee could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:49:36.860390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-73397a4d-4177-45c9-957e-3ceba169c273 tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "DELETE /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 404 len: 111 microversion: 2.1 time: 0.084073 Dec 02 15:49:36.861259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 106/200] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:49:36 2020] DELETE /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:49:36.875197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:36.875781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] [instance: 01fd7e98-e386-4d4c-8795-01ea862e34ee] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:36.884649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.885156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.886016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.886503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.897417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:36.898268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:36.906582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.907088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.908045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:36.908594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:36.944918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] HTTP exception thrown: Instance 01fd7e98-e386-4d4c-8795-01ea862e34ee could not be found. Dec 02 15:49:36.945795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] Returning 404 to user: Instance 01fd7e98-e386-4d4c-8795-01ea862e34ee could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:49:36.946682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f27bad90-3e2f-4bdb-9dd0-fbc713517aee tempest-DeleteServersTestJSON-1908149116 tempest-DeleteServersTestJSON-1908149116] 10.222.0.101 "GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee" status: 404 len: 111 microversion: 2.1 time: 0.081324 Dec 02 15:49:36.968451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 95/201] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:36 2020] GET /compute/v2.1/servers/01fd7e98-e386-4d4c-8795-01ea862e34ee => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:49:37.099677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:37.113423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:37.121586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:37.122089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:37.122925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:37.123409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:37.321498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-683f151a-b131-4999-91c2-15258ccb158c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.231473 Dec 02 15:49:37.322742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 96/202] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:37 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 02 15:49:37.380754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:37.391655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-606cf927-2e1e-4dc7-a121-a35dc0f84c1b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.504568 Dec 02 15:49:37.393491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 107/203] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:36 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:37.417312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:37.418635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:37.428523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:37.429059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:37.429923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:37.430415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:37.615754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c9f15be8-ed9a-4dc6-b67c-01c4d7ab7236 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.209351 Dec 02 15:49:37.616475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 97/204] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:37 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:37.620144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:37.620843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:37.629530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:37.630045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:37.630896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:37.631401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.128648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:38.141910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c87cab09-9226-4e3c-ba4b-0b0135d123e9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.532151 Dec 02 15:49:38.142829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 108/205] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:37 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:38.290126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-81042146", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "0e8d58a1-9518-45ad-8e30-37b570122f7b"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:38.338795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:38.339839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:38.348660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:38.349448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.350268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:38.350718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.521203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-31f4c914-12ec-4cbd-8641-bfd2cb688439 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.191875 Dec 02 15:49:38.524880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 109/206] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:38 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:38.533451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:38.534406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:38.542961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:38.543461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.544454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:38.545103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.779865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:38.790146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5dc52663-cc09-44d0-ba43-e303953a97f2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.266983 Dec 02 15:49:38.794901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 110/207] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:38 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:38.802426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:38.803496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:38.812664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:38.813184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.815295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:38.815818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:38.956640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] validate_networks() for [('0e8d58a1-9518-45ad-8e30-37b570122f7b', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:49:38.996191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6b3f9859-8c50-4617-8a9c-46668ca886dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.203973 Dec 02 15:49:38.996894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 111/208] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:38 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:39.167624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:39.168436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:39.177561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:39.178068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:39.178913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:39.179405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:39.457893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:39.468064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-70949a85-fec5-41f7-83f9-6e556fb60397 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.311520 Dec 02 15:49:39.469051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 112/209] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:39 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:39.538471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:39.539628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:39.548366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:39.548950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:39.550022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:39.550504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:39.707098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-de5c36ec-ffda-4bfe-b288-70aee11116cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.177605 Dec 02 15:49:39.711131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 113/210] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:39 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:49:39.816392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:39.817159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:39.825619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:39.826114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:39.826972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:39.827436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.015745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:49:40.016285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:49:40.017441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:49:40.018277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:49:40.018755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:49:40.029408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.029924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.030811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.031313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.051779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:49:40.056968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for user 792f7ff55fec492a8cf35f9e27c85210 and project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:49:40.072216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:49:40.075805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:49:40.106286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:40.116407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-89631ddd-73c0-4a12-a5da-556617fe771e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.310833 Dec 02 15:49:40.117357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 114/211] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:39 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:40.136934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:40.137989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:40.146952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.147452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.148315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.148804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.203744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7342c0a8-12aa-4fb6-a0c5-60020f77b86e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.925025 Dec 02 15:49:40.207222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 98/212] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:49:38 2020] POST /compute/v2.1/servers => generated 382 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:49:40.222429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2a7b899f-d096-42f3-bad5-f4e7a5c6937a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:40.223105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2a7b899f-d096-42f3-bad5-f4e7a5c6937a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:40.316087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2a7b899f-d096-42f3-bad5-f4e7a5c6937a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:40.325272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2a7b899f-d096-42f3-bad5-f4e7a5c6937a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1220 microversion: 2.1 time: 0.112356 Dec 02 15:49:40.325895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 99/213] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:40 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:40.365310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-31eb8cca-18de-4e90-8456-a7d997afb02f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.237580 Dec 02 15:49:40.366001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 115/214] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:40 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:40.492684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:40.493482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:40.503490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.504336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.505404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.505905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.732835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:40.737386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:40.758602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.759021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.761721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.762236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.838547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:40.850827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-78609d61-25f1-4fec-8579-fb7697e3eb7d tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.368501 Dec 02 15:49:40.855367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 100/215] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:40 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:40.946584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-0fbe7be1-6a07-457e-88d6-d557c82e0f04 req-af49ea9e-a4a6-4359-b9e6-ba6362eb91bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d2cade-ff55-4d31-9cbd-8b9575d38b52", "name": "network-vif-plugged", "status": "completed", "tag": "6ca07d1b-88a8-4b33-89ea-6b80adb12fa7"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:40.954790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:40.954790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:40.964050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-0fbe7be1-6a07-457e-88d6-d557c82e0f04 req-af49ea9e-a4a6-4359-b9e6-ba6362eb91bc service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:40.964561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-0fbe7be1-6a07-457e-88d6-d557c82e0f04 req-af49ea9e-a4a6-4359-b9e6-ba6362eb91bc service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:40.982744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e1014923-b90c-4dba-a852-49988fd42160 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 14 microversion: 2.1 time: 0.266958 Dec 02 15:49:40.983432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 116/216] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:40 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 14 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 02 15:49:40.989441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-0fbe7be1-6a07-457e-88d6-d557c82e0f04 req-af49ea9e-a4a6-4359-b9e6-ba6362eb91bc service nova] Creating event network-vif-plugged:6ca07d1b-88a8-4b33-89ea-6b80adb12fa7 for instance 00d2cade-ff55-4d31-9cbd-8b9575d38b52 on hv-cinder-73761 Dec 02 15:49:40.994903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-0fbe7be1-6a07-457e-88d6-d557c82e0f04 req-af49ea9e-a4a6-4359-b9e6-ba6362eb91bc service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061463 Dec 02 15:49:40.995697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 101/217] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:40 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:41.140988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:41.142356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:41.152243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.152758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.154174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.154668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.354401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:41.356243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:41.366366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.366941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.367786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.368336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.428704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:41.438669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-31b33a57-f4dd-4424-abba-f18e80791df2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.306976 Dec 02 15:49:41.439374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 117/218] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:41 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:41.449837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:41.450894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:41.460187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.460695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.461544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.462034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.517485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:41.526960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d0e9f7b0-c463-4c20-90f8-e1b6ed2e49b1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1216 microversion: 2.1 time: 0.187083 Dec 02 15:49:41.528093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 102/219] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:41 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:41.693757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4b4bc5a9-ff48-4446-9706-5245eeb2bcfa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.253065 Dec 02 15:49:41.695100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 118/220] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:41 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:41.879646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:41.880391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:41.889417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.889923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:41.890879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:41.891909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.002078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:42.003247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:42.012744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.013338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.014280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.014849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.148100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:42.157941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-29a1edb2-0dba-4c68-a1b1-48be29199baf tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.288898 Dec 02 15:49:42.158508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 103/221] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:41 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:42.293681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7fd26de3-b3a7-4e22-a439-477b9eb63e57 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 1407 microversion: 2.1 time: 0.302168 Dec 02 15:49:42.294376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 119/222] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:41 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:42.463781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:42.464504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:42.474772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.475284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.476210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.476717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.557467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:42.558327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:42.568827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.569338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.570182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.570674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.721343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:42.725345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:42.733402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d41e4b8e-633b-451f-9a02-cb1b51fca7fd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1272 microversion: 2.1 time: 0.188747 Dec 02 15:49:42.734366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 120/223] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:42 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:42.739427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-08c0471a-06c6-40fd-9dbc-5c0c86a0101e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.285626 Dec 02 15:49:42.740412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 104/224] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:42 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:42.750145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:42.752079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:42.761158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.761683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.762538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:42.763033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:42.975107 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-63716abf-43f9-435b-84f3-add21724932e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.238352 Dec 02 15:49:42.976638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 121/225] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:42 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:43.184181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:43.185503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:43.194617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.195312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.196505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.197076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.311809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:43.313621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:43.333609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.342543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.343799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.345048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.644164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d56a5b19-fc4d-450d-a953-210d2b877866 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 6451 microversion: 2.1 time: 0.342540 Dec 02 15:49:43.646998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 122/226] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:43 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 6451 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:43.650712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:43.660856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0493072d-c7a1-4ae7-a70e-683caf627866 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1317 microversion: 2.1 time: 0.489509 Dec 02 15:49:43.661868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 105/227] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:43 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:43.765934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:43.767795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:43.774164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:43.777752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.778669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.779849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.780577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.781203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:43.798322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.798825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.801439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:43.801950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:43.956800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:43.968346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6c5e48cd-54cd-4f56-b6af-a774ffc6273f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1278 microversion: 2.1 time: 0.219897 Dec 02 15:49:43.968963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 123/228] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:43 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:43.994237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:43.995583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:44.005369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:44.006726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:44.006868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:44.007431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:44.208597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:44.219691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-36d3c231-557f-4830-a345-f6a362a8b1dc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.465436 Dec 02 15:49:44.220351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 106/229] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:43 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:44.277473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5d10f3d3-ad0e-4823-89dd-e925fa111b8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.292704 Dec 02 15:49:44.280674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 124/230] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:43 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:44.661353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:44.662817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:44.677835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:44.678356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:44.679389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:44.679895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:44.694941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:44.695944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:44.706950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:44.707573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:44.708566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:44.709401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:44.920546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-89c2a456-683b-4b14-97f7-2a634c827912 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 9709 microversion: 2.1 time: 0.268994 Dec 02 15:49:44.921342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 107/231] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:44 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 9709 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:45.004381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:45.005260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:45.016281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.020837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.027056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.027923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.136252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:45.158078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e40a76e-6c1d-4d37-b0c1-2c3834c7e1e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1502 microversion: 2.1 time: 0.480779 Dec 02 15:49:45.158716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 125/232] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:44 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1502 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:45.246142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:45.246965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:45.273429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.273937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.274786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.275270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.697405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:45.706157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:45.708863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-75880db7-14c9-4b88-b728-77250b50d155 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.474909 Dec 02 15:49:45.709668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 126/233] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:45 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:45.715657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9e1de573-aa5a-4098-a9f2-f88c93d93ff3 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.732453 Dec 02 15:49:45.716444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 108/234] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:44 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:45.721005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:45.722043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:45.729987 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.730458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.731288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.731765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.939802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:45.941369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:45.949936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.950597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:45.951549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:45.952303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:46.054017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c6ddb5bb-53dd-454f-acc2-1044ad2c253b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.342780 Dec 02 15:49:46.054840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 127/235] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:45 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:46.148681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3780d158-4193-46e1-a529-c079bf8717da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 12581 microversion: 2.1 time: 0.218611 Dec 02 15:49:46.149976 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 109/236] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:45 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 12581 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:46.733501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:46.734279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:46.752147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:46.753089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:46.758811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:46.759322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:46.761360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:46.762233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:46.777892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:46.778407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:46.779273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:46.779773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.040226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:47.051427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-131a2461-36b9-4de6-bc66-e2245fce79cf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.327976 Dec 02 15:49:47.056059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 128/237] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:46 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:47.062707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:47.063889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:47.072336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.072839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.073672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.074160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.157468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:49:47.328832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:47.340002 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ab97bfa5-d00b-405d-8158-e7b45a026d13 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.605216 Dec 02 15:49:47.340846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 110/238] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:46 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:47.354105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-709807e1-fcb8-4522-8692-9e769fc5e879 req-a90a84b6-5ad1-45a5-868b-48c9cc92facc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7ff8d5-f591-4e0f-b4b4-162363b1135b", "tag": "bcba1c17-23ad-42ca-a39f-5066ffafea07"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:47.362579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:47.362579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:47.372607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-709807e1-fcb8-4522-8692-9e769fc5e879 req-a90a84b6-5ad1-45a5-868b-48c9cc92facc service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.373240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-709807e1-fcb8-4522-8692-9e769fc5e879 req-a90a84b6-5ad1-45a5-868b-48c9cc92facc service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.394148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-709807e1-fcb8-4522-8692-9e769fc5e879 req-a90a84b6-5ad1-45a5-868b-48c9cc92facc service nova] Creating event network-changed:bcba1c17-23ad-42ca-a39f-5066ffafea07 for instance fc7ff8d5-f591-4e0f-b4b4-162363b1135b on hv-cinder-73761 Dec 02 15:49:47.399515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-709807e1-fcb8-4522-8692-9e769fc5e879 req-a90a84b6-5ad1-45a5-868b-48c9cc92facc service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056945 Dec 02 15:49:47.400198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 111/239] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:47 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:47.412460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:47.413628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:47.421785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.422331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.424366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.433044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.565229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f0e8ea07-4077-463e-8d2c-a5c36973d4b5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "DELETE /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 204 len: 0 microversion: 2.1 time: 0.511595 Dec 02 15:49:47.566161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 129/240] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:49:47 2020] DELETE /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:49:47.583191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:47.584423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:47.594885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.595168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.596052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.596541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.738261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e8dd4ea1-9243-46f4-9d1b-f414224589b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 14 microversion: 2.20 time: 0.336491 Dec 02 15:49:47.738932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 112/241] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:47 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 14 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:47.761960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:47.767447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:47.781015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.781683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.783166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:47.783773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:47.796178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2120ee86-33f3-43bc-b355-19e9ec31c0ae tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 16035 microversion: 2.1 time: 0.223948 Dec 02 15:49:47.797082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 130/242] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:47 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 16035 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:48.077034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:48.077800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:48.088527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.088860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.089713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.090308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.210770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:48.223125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-09e36781-3af5-478f-8b4b-defa1a50f9a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1508 microversion: 2.1 time: 0.481464 Dec 02 15:49:48.223922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 113/243] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:47 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:48.336278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:48.345737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ca45caff-0e2a-4239-b4b8-adce369fcb42 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.279068 Dec 02 15:49:48.346338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 131/244] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:48 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:48.363880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:48.364595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:48.372726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.373243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.374099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.374627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.756319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:48.757422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:48.783457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:48.787355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.787874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.788795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.789297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.802649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d1cb3290-a06e-40cc-aad8-315a194762cc tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.448870 Dec 02 15:49:48.804424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 114/245] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:48 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:48.817154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:48.818845 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:48.834467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.835075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:48.836201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:48.837119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.092088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2eeb32f2-8b31-421c-8e46-8eb1ab152283 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 6451 microversion: 2.20 time: 0.345644 Dec 02 15:49:49.093331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 132/246] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:48 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 6451 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:49:49.114670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c2bd2eff-4abe-40a2-9493-67fa15e64445 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 17602 microversion: 2.1 time: 0.308643 Dec 02 15:49:49.116129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 115/247] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:48 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 17602 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:49.249200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:49.249986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:49.259390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:49.259900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.260801 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:49.261301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.369775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:49.370481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:49.379965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:49.380509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.381366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:49.381862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.518055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:49.527698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f8160169-4f3d-4a7b-9565-a6b978c9dc9e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1508 microversion: 2.1 time: 0.288746 Dec 02 15:49:49.528598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 133/248] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:49 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:49.837030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:49.837744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:49.848106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:49.848625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.849478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:49.849960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:49.850898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:49.859935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-24cad729-305e-4770-aa60-6b7a713e4797 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.500819 Dec 02 15:49:49.861085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 116/249] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:49 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:50.098611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:50.110278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5e9b7e14-c0cf-47dc-924f-4a68526f2303 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.288050 Dec 02 15:49:50.113777 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 134/250] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:49 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:50.117189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:50.118343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:50.130770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.131321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.132214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.132581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:50.132707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.133722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:50.142451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.142961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.143808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.144377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.474565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-48856b81-cca4-469a-88dd-87ac8c199101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 9847 microversion: 2.20 time: 0.371782 Dec 02 15:49:50.474565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 117/251] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:50 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 9847 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:49:50.545854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-318cdd5d-b693-4366-95db-85fb083ba656 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 17861 microversion: 2.1 time: 0.422527 Dec 02 15:49:50.546696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 135/252] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:50 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 17861 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:49:50.553212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:50.553993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:50.563450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.563960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.564840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.565330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.896282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:50.897384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:50.905766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.906573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.908166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:50.908672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:50.937736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:50.950182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fe3aa477-f80c-4a97-9981-4353ee1a320e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1508 microversion: 2.1 time: 0.407263 Dec 02 15:49:50.950973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 118/253] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:50 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:51.139522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:51.140907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:51.153299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:51.157581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.158505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.160008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.160858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.163617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-705fffbf-4711-4730-8f88-4c38913bf771 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.287823 Dec 02 15:49:51.164375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 136/254] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:50 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:51.463810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:51.473508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1b207a30-d641-4418-bf4a-618981ee908f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.349050 Dec 02 15:49:51.474343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 119/255] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:51 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:51.492572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:51.493660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:51.502702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.503208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.504074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.504570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.566028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:51.567228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:51.576628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.577153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.578013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.579377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.669515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-afe4ae39-2afd-49ee-bfdb-868bc755c033 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 13107 microversion: 2.20 time: 0.186875 Dec 02 15:49:51.670098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 137/256] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:51 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 13107 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:49:51.788682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9bdb76ae-468d-4e94-b95a-d50e6c64ebeb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 19342 microversion: 2.1 time: 0.233457 Dec 02 15:49:51.789465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 120/257] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:51 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 19342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:49:51.976931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:51.977785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:51.987034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.990726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:51.991897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:51.992914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.175896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:52.185855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a476a20a-da82-4dfc-898b-f89e2cab5013 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1466 microversion: 2.1 time: 0.218744 Dec 02 15:49:52.185855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 138/258] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:51 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1466 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:52.193610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:52.194380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:52.203281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.207880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.207880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.207880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.497915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:52.498887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:52.507927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.508471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.509333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.509823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.639250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:52.650034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4e501a57-0d33-409f-be10-b40361744cde tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.467177 Dec 02 15:49:52.650455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 121/259] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:52 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:52.661758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-e0d220b0-f92d-4e30-9fbf-bddbf8f451f6 req-3a877831-3514-441a-95a3-9eed6b3f32ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00d2cade-ff55-4d31-9cbd-8b9575d38b52", "name": "network-vif-deleted", "tag": "6ca07d1b-88a8-4b33-89ea-6b80adb12fa7"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:52.668829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:52.668829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:52.679646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e0d220b0-f92d-4e30-9fbf-bddbf8f451f6 req-3a877831-3514-441a-95a3-9eed6b3f32ff service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.680104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e0d220b0-f92d-4e30-9fbf-bddbf8f451f6 req-3a877831-3514-441a-95a3-9eed6b3f32ff service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.699742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-e0d220b0-f92d-4e30-9fbf-bddbf8f451f6 req-3a877831-3514-441a-95a3-9eed6b3f32ff service nova] Creating event network-vif-deleted:6ca07d1b-88a8-4b33-89ea-6b80adb12fa7 for instance 00d2cade-ff55-4d31-9cbd-8b9575d38b52 on hv-cinder-73761 Dec 02 15:49:52.706193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-e0d220b0-f92d-4e30-9fbf-bddbf8f451f6 req-3a877831-3514-441a-95a3-9eed6b3f32ff service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054253 Dec 02 15:49:52.706850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 122/260] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:52 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:49:52.718539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:52.720401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:52.728803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.729336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.730175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.730670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.740130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:52.748965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cb8aac5e-6c63-42ed-b2bf-6f712f7617b7 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.260497 Dec 02 15:49:52.749541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 139/261] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:52 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:49:52.806912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:52.808086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:52.816712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.817208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:52.818047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:52.818535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.166730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-16b14142-34d5-44c1-9d42-60e481985bd5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 16183 microversion: 2.20 time: 1.458131 Dec 02 15:49:54.167863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 123/262] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:52 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 16183 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:49:54.179962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:54.180782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:54.190166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.190677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.191564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.192088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.285439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.285943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.286444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lazy-loading 'fault' on Instance uuid 00d2cade-ff55-4d31-9cbd-8b9575d38b52 {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:49:54.408176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:54.417202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-75bbc93f-860c-4ff9-8f39-ef48abea1f16 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1307 microversion: 2.1 time: 0.248173 Dec 02 15:49:54.417802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 124/263] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:54 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1307 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:54.428303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:54.428974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:54.437506 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.438539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.439387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.439881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.667706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:54.677363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4cbaa278-a8c1-4e50-b165-a92313621800 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.258482 Dec 02 15:49:54.677966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 125/264] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:54 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:54.688537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:54.689480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:54.697606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.698227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.699162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:54.699559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:54.926130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:54.935089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a49c76af-9396-4913-8d75-4cb2c4fa5172 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.256066 Dec 02 15:49:54.935678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 126/265] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:54 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:55.185373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:55.186333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:55.195393 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:55.195905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:55.196819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:55.197314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.161560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0d005479-f7d3-42c9-acbe-5e9eb10193b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 23804 microversion: 2.1 time: 3.365338 Dec 02 15:49:56.162254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 140/266] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:52 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 23804 bytes in 3367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:56.173884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:56.174705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:56.183620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.184156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.185164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.185669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.229701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a7d6ec40-a8c7-4cac-9120-15a7f6b12c3b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 19243 microversion: 2.20 time: 1.053490 Dec 02 15:49:56.230391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 127/267] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:55 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 19243 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:49:56.242024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:56.242793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:56.252234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.252760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.253623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.254142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.333473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.334095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.334683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lazy-loading 'fault' on Instance uuid 00d2cade-ff55-4d31-9cbd-8b9575d38b52 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:49:56.511059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:56.521256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3510fed1-7477-408c-9d80-7b3a59069f31 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.289562 Dec 02 15:49:56.522263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 128/268] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:56 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:56.541504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:56.542204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:56.553303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.554029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.554941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:56.555449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:56.647837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:56.658636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4ceff2a2-26ac-4011-a5e0-1e1ba9fc94e2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 200 len: 1307 microversion: 2.1 time: 0.494912 Dec 02 15:49:56.659652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 141/269] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:56 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 1307 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:56.872331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:56.884803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e9fcfcc3-d847-4d0d-a279-7b0dad8c3b72 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.356010 Dec 02 15:49:56.885328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 129/270] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:56 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:57.040264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-b6959f08-2170-4bf7-a450-9dfd4298a901 req-235dab88-abd4-48c9-b28b-122db4ca350d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7ff8d5-f591-4e0f-b4b4-162363b1135b", "name": "network-vif-plugged", "status": "completed", "tag": "bcba1c17-23ad-42ca-a39f-5066ffafea07"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:57.048933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:49:57.048933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:49:57.060704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b6959f08-2170-4bf7-a450-9dfd4298a901 req-235dab88-abd4-48c9-b28b-122db4ca350d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.061429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b6959f08-2170-4bf7-a450-9dfd4298a901 req-235dab88-abd4-48c9-b28b-122db4ca350d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.104196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-b6959f08-2170-4bf7-a450-9dfd4298a901 req-235dab88-abd4-48c9-b28b-122db4ca350d service nova] Creating event network-vif-plugged:bcba1c17-23ad-42ca-a39f-5066ffafea07 for instance fc7ff8d5-f591-4e0f-b4b4-162363b1135b on hv-cinder-73761 Dec 02 15:49:57.121619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-b6959f08-2170-4bf7-a450-9dfd4298a901 req-235dab88-abd4-48c9-b28b-122db4ca350d service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095674 Dec 02 15:49:57.123114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 142/271] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:49:57 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:49:57.181134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:57.182194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:57.191319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.191814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.192695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.193187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.249369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:57.250577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:57.259990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.260567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.261988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.262666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.372525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-342bc014-9d4c-479d-9ffe-09b93930862b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 24262 microversion: 2.1 time: 0.201642 Dec 02 15:49:57.373227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 130/272] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:57 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 24262 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:57.502248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a9fca05f-c2df-436c-b3f1-b497f534af9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 20745 microversion: 2.20 time: 0.263447 Dec 02 15:49:57.503204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 143/273] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:57 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 20745 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:49:57.547247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:57.548240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:57.558725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.559322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.560402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.561136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.683044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:57.684029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: 00d2cade-ff55-4d31-9cbd-8b9575d38b52] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:57.693011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.693521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.694391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.695238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.793962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] HTTP exception thrown: Instance 00d2cade-ff55-4d31-9cbd-8b9575d38b52 could not be found. Dec 02 15:49:57.794856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Returning 404 to user: Instance 00d2cade-ff55-4d31-9cbd-8b9575d38b52 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:49:57.795963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7a450612-512f-4c52-b614-ec959dd73a58 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52" status: 404 len: 111 microversion: 2.1 time: 0.122787 Dec 02 15:49:57.796750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 144/274] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:57 2020] GET /compute/v2.1/servers/00d2cade-ff55-4d31-9cbd-8b9575d38b52 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:49:57.806555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:57.818516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-824ddfe9-5380-4c0b-9649-fc0cd928509d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.281476 Dec 02 15:49:57.819296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 131/275] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:57 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:57.909523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:57.910313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:57.919562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.920103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.921154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:57.921650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:57.931688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-73381098", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "ff174474-e4b7-43a0-9a9f-af048d26f968"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:58.030053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] validate_networks() for [('ff174474-e4b7-43a0-9a9f-af048d26f968', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:49:58.297944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:58.318605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4a6e7620-2b30-47d3-8a2c-612419127d0f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.419369 Dec 02 15:49:58.319585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 145/276] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:57 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:58.391626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:58.393030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:58.412335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.413118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.414176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.414857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.622913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-49ab7098-029c-491b-9cea-faf0bf616fff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 24782 microversion: 2.1 time: 0.241340 Dec 02 15:49:58.624114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 146/277] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:58 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 24782 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:49:58.643446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:58.651291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:58.672324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.673084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.675558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.676865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.722464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:49:58.723079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:49:58.723626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:49:58.724293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:49:58.724912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:49:58.735647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.737156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.738245 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.738743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.760277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Getting quotas for project 56c9112430664980ab7f1093238878e5. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:49:58.764748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Getting quotas for user c69aacc8110b4aaf93aaebe8d1ce6fa4 and project 56c9112430664980ab7f1093238878e5. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:49:58.777044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:49:58.779674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:49:58.859935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c4b685c5-26c0-4d5f-aa37-5889147e803c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.941203 Dec 02 15:49:58.860666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 132/278] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:49:57 2020] POST /compute/v2.1/servers => generated 382 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Dec 02 15:49:58.870807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:58.871596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:58.877119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-742deb39-3891-4cc6-9957-d738cc39eff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 21959 microversion: 2.20 time: 0.250677 Dec 02 15:49:58.878156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 147/279] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:58 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 21959 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:49:58.880754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.881261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.882117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:58.882613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:58.891902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a686df9d-33c9-4d55-8e9f-12ebf1d00073 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:58.893181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a686df9d-33c9-4d55-8e9f-12ebf1d00073 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:59.031303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a686df9d-33c9-4d55-8e9f-12ebf1d00073 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:59.050507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a686df9d-33c9-4d55-8e9f-12ebf1d00073 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1216 microversion: 2.1 time: 0.170242 Dec 02 15:49:59.058629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 148/280] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:58 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:59.157463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:59.167433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b8fa0fae-a21e-4940-b88d-a933d9f91973 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.305536 Dec 02 15:49:59.168275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 133/281] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:58 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:59.346156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:49:59.346837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:59.360045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:59.360690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:59.361777 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:59.362283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:59.601358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:49:59.611739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b016467a-134d-4842-b91b-5900dee7ce01 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1320 microversion: 2.1 time: 0.276274 Dec 02 15:49:59.612888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 149/282] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:49:59 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:49:59.640561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:59.641670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:59.650105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:59.650823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:59.651861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:59.652544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:59.902140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:49:59.903290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:49:59.913262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:59.913943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:59.914768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:49:59.915425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:49:59.960862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-76124702-a863-47e5-acd1-5c6900c0a6ba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 25522 microversion: 2.1 time: 0.321004 Dec 02 15:49:59.964632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 134/283] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:49:59 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 25522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:00.094984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:00.096200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:00.116173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:00.117048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:00.118141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:00.118822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:00.158317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a286f949-b02f-4916-b302-9c88d360ef7a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 22961 microversion: 2.20 time: 0.272481 Dec 02 15:50:00.159146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 150/284] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:49:59 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 22961 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:00.193937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:00.194896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:00.204931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:00.207914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:00.207914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:00.207914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:00.296932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:00.306545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-aea1b759-c1fd-4f48-a2d1-6e56aa4f2d90 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1212 microversion: 2.1 time: 0.237627 Dec 02 15:50:00.308259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 135/285] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:00 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1212 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:00.457751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:00.468333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bb9c4f40-14d9-4204-9c04-43539c973393 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.285720 Dec 02 15:50:00.468950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 151/286] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:00 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:00.637131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:00.638081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:00.646866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:00.647742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:00.649007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:00.649392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:00.918220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:00.928457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a52d3024-2c02-4b82-a7c1-f53b3987c805 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1510 microversion: 2.1 time: 0.300448 Dec 02 15:50:00.929563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 136/287] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:00 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1510 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:00.992220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:00.995133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:01.009118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.010474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.012459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.013698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.185226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:01.201412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:01.211318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.211828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.212773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.213337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.253221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ad0a6abd-a900-4716-b10c-6287e65c9988 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 26097 microversion: 2.1 time: 0.280821 Dec 02 15:50:01.256049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 152/288] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:00 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 26097 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:50:01.334932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:01.335708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:01.344822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.345340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.346198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.346697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.435434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7a3dc526-ecb7-443b-a2e5-ce21674257c3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 23575 microversion: 2.20 time: 0.267699 Dec 02 15:50:01.436651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 137/289] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:01 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 23575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:01.502184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:01.502969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:01.517613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.523730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.523730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:01.523730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:01.540569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:01.562371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4ce5272f-660f-46c5-89f2-7e344af0ac20 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1276 microversion: 2.1 time: 0.239347 Dec 02 15:50:01.575550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 153/290] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:01 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:02.182847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:02.195996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cd9084b4-7b6b-4bc3-8ba6-47ae25d7ca66 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.705448 Dec 02 15:50:02.196705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 138/291] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:01 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:02.274471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:02.275547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:02.285155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:02.285668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:02.286524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:02.287019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:02.455459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:02.456884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:02.458709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e1731569-89d5-4e0c-86d4-ed8faef1b353 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 26565 microversion: 2.1 time: 0.195468 Dec 02 15:50:02.459819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 154/292] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:02 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 26565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:02.466362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:02.470768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:02.470768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:02.470768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:02.600407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:02.601753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:02.617492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:02.618494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:02.620196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:02.621405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:02.644765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e17890b2-15b2-42bb-9347-26cf29e9b015 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 24322 microversion: 2.20 time: 0.199384 Dec 02 15:50:02.649537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 139/293] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:02 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 24322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:02.904711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:02.938633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7428de0e-8c6a-4439-8a22-0c9426088eb9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1274 microversion: 2.1 time: 0.359241 Dec 02 15:50:02.952866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 155/294] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:02 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1274 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:03.004399 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864fee20-1e33-4ad3-918d-676f20a7084f"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:03.005739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:03.015004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.015804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.017192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.017824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.225572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:03.226445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:03.258900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.259921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.264298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.264886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.544461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:03.556086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-33d20c66-b138-4684-a740-0649499ed040 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.345442 Dec 02 15:50:03.557163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 156/295] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:03 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:03.569233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:03.571102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:03.580764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.582360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.583569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.584248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.903499 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-edf55928-e13d-4dc3-ab92-9a4b12a24669 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 27163 microversion: 2.1 time: 0.344803 Dec 02 15:50:03.904711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 157/296] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:03 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 27163 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:03.916535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:03.917752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:03.927536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.928406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:03.929312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:03.929983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:04.146442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-85f529da-9872-479d-97db-ab82968aecf2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 25296 microversion: 2.20 time: 0.239937 Dec 02 15:50:04.147426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 158/297] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:03 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 25296 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:04.159472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:04.160542 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:04.169659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:04.170453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:04.171297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:04.172387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:04.464584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:04.469322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0a7fae05-6676-4c3f-ba66-4dad97a936bd tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.484379 Dec 02 15:50:04.470360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 140/298] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:50:02 2020] POST /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b/os-volume_attachments => generated 194 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:04.481490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f72134a6-33a2-4eb4-a1a2-44f9282a4f37 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.332554 Dec 02 15:50:04.482215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 159/299] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:04 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:04.617583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:04.618371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:04.645964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:04.646470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:04.651090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:04.655470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:04.920966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:04.923239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:04.931963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:04.932642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:04.933627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:04.934259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:05.273557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-669abdd7-3ad5-4f17-b70f-a69dca3a0093 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 27454 microversion: 2.1 time: 0.361150 Dec 02 15:50:05.275286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 160/300] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:04 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 27454 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:05.324243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:05.333670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:05.346074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:05.379024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:05.384187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:05.385839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:05.388775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:05.409520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f191f449-fd0c-4c4f-8c7d-6b4181b5d061 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1526 microversion: 2.1 time: 0.837601 Dec 02 15:50:05.431101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 141/301] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:04 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1526 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:05.507376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:05.512614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:05.541263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:05.551461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:05.552664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:05.556834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:05.832088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4c2ac962-72a0-40d9-ab7b-b725db2668d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 26069 microversion: 2.20 time: 0.545713 Dec 02 15:50:05.836479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 161/302] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:05 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 26069 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:06.269310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:06.279453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-6477b4b8-d042-4fb2-8fdb-68c70a3a2e9c req-e93ca61a-9922-4b4f-bce7-5f6f5f5c695e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1057858-aa53-42ac-8b43-08a1c748f79c", "tag": "83b04747-0785-4468-a620-adb9e32ec302"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:06.284322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-87dc76f3-e7c1-4c3a-8eef-0fa8f90319f4 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.786869 Dec 02 15:50:06.285298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 142/303] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:05 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:06.286860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:50:06.286860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:50:06.296815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-6477b4b8-d042-4fb2-8fdb-68c70a3a2e9c req-e93ca61a-9922-4b4f-bce7-5f6f5f5c695e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.297538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-6477b4b8-d042-4fb2-8fdb-68c70a3a2e9c req-e93ca61a-9922-4b4f-bce7-5f6f5f5c695e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.298318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:06.299696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:06.310052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.310693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.311663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.313407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.319688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-6477b4b8-d042-4fb2-8fdb-68c70a3a2e9c req-e93ca61a-9922-4b4f-bce7-5f6f5f5c695e service nova] Creating event network-changed:83b04747-0785-4468-a620-adb9e32ec302 for instance a1057858-aa53-42ac-8b43-08a1c748f79c on hv-cinder-73761 Dec 02 15:50:06.324818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-6477b4b8-d042-4fb2-8fdb-68c70a3a2e9c req-e93ca61a-9922-4b4f-bce7-5f6f5f5c695e service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054923 Dec 02 15:50:06.325447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 162/304] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:50:06 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:50:06.455927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:06.459828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:06.474242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.474996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.476231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.476870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.588628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a1769a9e-a6c1-4a3d-b1bb-75c08464f900 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 27687 microversion: 2.1 time: 0.299201 Dec 02 15:50:06.593191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 143/305] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:06 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 27687 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:06.859535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:06.873291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e654f331-d412-47f4-81fd-1f056949349a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1506 microversion: 2.1 time: 0.435567 Dec 02 15:50:06.876617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:06.878923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:06.884786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 163/306] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:06 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:06.897953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.899204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.900636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:06.901266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.901378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:06.902161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.911856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.912616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:06.913646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:06.914345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:07.206839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1c8fc700-80a5-4e02-87dc-755ebd7ea144 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 26861 microversion: 2.20 time: 0.353300 Dec 02 15:50:07.214176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 144/307] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:06 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 26861 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:07.258170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:07.287637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9126d944-5e92-47a4-a9c0-a9c1a8d7394a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1520 microversion: 2.1 time: 0.398413 Dec 02 15:50:07.300594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 164/308] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:06 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1520 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:07.330330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:07.339486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:07.364170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:07.365245 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:07.366392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:07.367101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:07.618241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:07.624482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:07.638172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:07.639241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:07.641080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:07.642016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:07.995584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-85edbc0f-5bd8-44e1-ba14-096187e200a1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28046 microversion: 2.1 time: 0.391997 Dec 02 15:50:07.997449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 165/309] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:07 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28046 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:08.287137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:08.289237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:08.315265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:08.316534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:08.318203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:08.319213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:08.588424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:08.599807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a511e61b-a247-4476-b3b6-fe2ee69a8637 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 1.284246 Dec 02 15:50:08.600481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 145/310] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:07 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:08.668545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-947dd97c-68bf-440c-a08c-c2b4219c57d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 27348 microversion: 2.20 time: 0.439794 Dec 02 15:50:08.675943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 166/311] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:08 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 27348 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:09.018600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:09.019915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:09.029504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:09.030204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:09.032230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:09.032899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:09.276388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f728eb18-2e86-4e2b-a4a1-2603179e0689 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28165 microversion: 2.1 time: 0.264270 Dec 02 15:50:09.276388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 146/312] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:09 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28165 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:09.631338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:09.633614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:09.658818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:09.659558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:09.660684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:09.661334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:09.719423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:09.721436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:09.773503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:09.774367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:09.775837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:09.776776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:10.033897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:10.043536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c4165806-93f4-4192-a53c-627d901c4462 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.427856 Dec 02 15:50:10.044167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 167/313] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:09 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:10.058195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f4e0b280-6934-4d64-9a60-466b480a4875 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 27585 microversion: 2.20 time: 0.377722 Dec 02 15:50:10.059728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 147/314] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:09 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 27585 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:10.300460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:10.301807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:10.330316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:10.331027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:10.332039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:10.332749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:10.374622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:10.377469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:10.387277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:10.388130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:10.389189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:10.389720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:10.499625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lazy-loading 'flavor' on Instance uuid 151ef38d-ba70-4859-93d6-24b1aad15e27 {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:50:10.569134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-992cd82e-8cf5-4c86-87db-1cf77f6e22d8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28165 microversion: 2.1 time: 0.283931 Dec 02 15:50:10.570793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 168/315] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:10 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28165 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:10.889817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dd60e8ff-5a19-4033-a394-210f64119b17 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action" status: 200 len: 32 microversion: 2.1 time: 0.527619 Dec 02 15:50:10.891234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 148/316] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:10 2020] POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action => generated 32 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:50:10.916525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:10.917306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:10.928583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:10.929103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:10.930007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:10.930510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.072657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:11.073727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:11.102149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:11.102945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.103995 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:11.104653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.375760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:11.415349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c057c47f-6a26-421c-bd1c-52ede69bf4bc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.514227 Dec 02 15:50:11.416708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 169/317] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:10 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:11.439495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:11.441417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:11.457954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:11.458887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.460546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:11.461463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.712925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9c84f2ed-bbda-4bb0-b514-316edad6c802 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 27888 microversion: 2.20 time: 0.293754 Dec 02 15:50:11.714384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 170/318] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:11 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 27888 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:11.721571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:11.737862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0f51bf34-6e67-41f8-89e7-f198f7b071c7 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.677786 Dec 02 15:50:11.738469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 149/319] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:11 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:11.747646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:11.749147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:11.761697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:11.762497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.763341 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:11.763833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:11.957921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a33bfc33-89b0-4d8e-ba99-6d009904b5c0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28165 microversion: 2.1 time: 0.240692 Dec 02 15:50:11.958510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 171/320] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:11 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28165 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:12.441333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:12.442009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:12.450729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:12.451453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:12.465802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:12.465802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:12.751191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:12.753985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:12.775628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:12.777032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:12.779406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:12.780865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:12.840623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:12.852462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-396a4605-8df1-4413-9368-af836a0e8ea4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.421526 Dec 02 15:50:12.853179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 150/321] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:12 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:12.866308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:12.867266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:12.876913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:12.877600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:12.878593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:12.879157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:13.475541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:13.488914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b380f24b-bb70-4c3d-8ec7-991aa6b5b7c1 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.634148 Dec 02 15:50:13.490393 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 151/322] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:12 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:13.503410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:13.504674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:13.520329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:13.521353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:13.523032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:13.523965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:15.391519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-54d773b3-a120-43e5-a967-fa31bfd23918 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28126 microversion: 2.20 time: 2.666737 Dec 02 15:50:15.394345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 172/323] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:12 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28126 bytes in 2670 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:15.403611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:15.404434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:15.414139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8f7b7d0f-2d09-48dd-9a6f-d1579c0e710b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28165 microversion: 2.1 time: 1.921619 Dec 02 15:50:15.414432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:15.414685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:15.420944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:15.421271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 152/324] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:13 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28165 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:15.421450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:15.430009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:15.431652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:15.449150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:15.450120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:15.451781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:15.452594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:15.737527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:15.747412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a4d62a37-c87a-4b69-a5ad-73ea75387a32 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.353637 Dec 02 15:50:15.750207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 173/325] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:15 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:15.776684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:15.787246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-915f18a7-985b-466f-8198-096b7fbc4371 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.369761 Dec 02 15:50:15.787873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 153/326] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:15 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:16.415574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:16.416908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:16.430010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.430971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.432169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.432776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.446703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:16.448677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:16.469613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.471822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.475100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.476527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.763436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2beec770-0896-4229-bd1f-2fcc2bfa47ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28126 microversion: 2.20 time: 0.361273 Dec 02 15:50:16.764210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 174/327] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:16 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28126 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:16.780069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-9159e590-3d2c-4b58-84db-9006fe2e8260 req-260d015f-103e-4813-a896-5f58aecd9a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1057858-aa53-42ac-8b43-08a1c748f79c", "name": "network-vif-plugged", "status": "completed", "tag": "83b04747-0785-4468-a620-adb9e32ec302"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:16.788621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:50:16.788621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:50:16.793979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b941f452-92d2-4b9d-94d8-e88cd3471c99 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28453 microversion: 2.1 time: 0.366653 Dec 02 15:50:16.799764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 154/328] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:16 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28453 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:50:16.800010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-9159e590-3d2c-4b58-84db-9006fe2e8260 req-260d015f-103e-4813-a896-5f58aecd9a04 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.800436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-9159e590-3d2c-4b58-84db-9006fe2e8260 req-260d015f-103e-4813-a896-5f58aecd9a04 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.820509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:16.821951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:16.822206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-9159e590-3d2c-4b58-84db-9006fe2e8260 req-260d015f-103e-4813-a896-5f58aecd9a04 service nova] Creating event network-vif-plugged:83b04747-0785-4468-a620-adb9e32ec302 for instance a1057858-aa53-42ac-8b43-08a1c748f79c on hv-cinder-73761 Dec 02 15:50:16.829258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-9159e590-3d2c-4b58-84db-9006fe2e8260 req-260d015f-103e-4813-a896-5f58aecd9a04 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063310 Dec 02 15:50:16.830054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 175/329] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:50:16 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:16.840146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.842486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.846070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.847294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.847735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:16.848551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:16.858385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.859532 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:16.860473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:16.860972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:17.300109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:17.306555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:17.313619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2f2c258a-5064-4356-8ad8-afd9ef58e427 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.513968 Dec 02 15:50:17.314358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 155/330] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:16 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:17.320294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-34db658e-c2bd-44b7-9a6b-1610d299a875 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.488491 Dec 02 15:50:17.321083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 176/331] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:16 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:17.347830 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864fee20-1e33-4ad3-918d-676f20a7084f"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:17.350320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:17.365963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:17.367295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:17.374047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:17.375531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:17.533571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] HTTP exception thrown: Invalid volume: volume 864fee20-1e33-4ad3-918d-676f20a7084f already attached Dec 02 15:50:17.534709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Returning 400 to user: Invalid volume: volume 864fee20-1e33-4ad3-918d-676f20a7084f already attached {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:50:17.535808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d65b1331-04e8-497a-a5a0-a3ac58d923d9 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b/os-volume_attachments" status: 400 len: 120 microversion: 2.1 time: 0.219993 Dec 02 15:50:17.537016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 156/332] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:50:17 2020] POST /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b/os-volume_attachments => generated 120 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 02 15:50:17.716027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:17.717247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:17.739917 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:17.740865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:17.743070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:17.744404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:17.785607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:17.814878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:17.814878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:17.814878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:17.814878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:17.816027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.136758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4e762034-c7b5-4e30-8c6d-874c4f3b7e8a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28126 microversion: 2.20 time: 0.362736 Dec 02 15:50:18.150746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 157/333] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:17 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28126 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:50:18.150746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:18.151600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:18.162264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:18.163243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.164350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:18.165037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.298054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-10fcb225-476f-40cd-9c9a-56bd7fbb3114 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b/os-volume_attachments/864fee20-1e33-4ad3-918d-676f20a7084f" status: 202 len: 0 microversion: 2.1 time: 0.603024 Dec 02 15:50:18.299455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 177/334] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:50:17 2020] DELETE /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b/os-volume_attachments/864fee20-1e33-4ad3-918d-676f20a7084f => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:18.363026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:18.364396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:18.381849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:18.383314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.385097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:18.386394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.427474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-de38913d-fae2-48d1-8df8-9ad32d0d4f87 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28453 microversion: 2.1 time: 0.288457 Dec 02 15:50:18.428565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 158/335] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:18 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28453 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:18.480078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:18.481496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:18.494987 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:18.496597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.497548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:18.498711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:18.956322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:18.968495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6fb56cc7-8738-4430-b82a-1ebb8b4e0127 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1316 microversion: 2.1 time: 0.534066 Dec 02 15:50:18.969943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 159/336] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:18 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1316 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:19.000015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:19.019271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e5aeabc4-ee24-4016-b6db-14985230da6f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.678262 Dec 02 15:50:19.020615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 178/337] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:18 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:19.339504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:19.339504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:19.339504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:19.339504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:19.342643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:19.342643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:19.458725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:19.461572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:19.482921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:19.482921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:19.484409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:19.485552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:19.490986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9f04b74d-627a-450c-b76f-1ee7dc722b2a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28413 microversion: 2.20 time: 0.334561 Dec 02 15:50:19.495079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 160/338] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:19 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28413 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:19.843596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2cdf78fb-f952-47ef-8e1d-c8b48261d2fc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28617 microversion: 2.1 time: 0.404427 Dec 02 15:50:19.844930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 179/339] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:19 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28617 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:20.044020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:20.045546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:20.074390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.075381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.077018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.088265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:20.089067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:20.101454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.102653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.102989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.103291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.103433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.647947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:20.663932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4c0c871a-a452-4637-907b-1aa521f0337c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.617625 Dec 02 15:50:20.665196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 180/340] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:20 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:20.684274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:20.685663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:20.696598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.697564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.698681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.699743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.728737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:20.740056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e50bb720-d20a-4b9d-8119-d6b42f4b43f9 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1500 microversion: 2.1 time: 0.756044 Dec 02 15:50:20.741523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 161/341] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:19 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1500 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:20.881252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:20.883133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:20.899796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.901276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.902949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:20.903880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:20.974673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-291354b5-fcf1-439f-b38f-b54784daefb0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28413 microversion: 2.20 time: 0.306851 Dec 02 15:50:20.976201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 181/342] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:20 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28413 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:21.192735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d314f894-4ea4-4f76-862d-fbf50709316c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28617 microversion: 2.1 time: 0.333970 Dec 02 15:50:21.194183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 162/343] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:20 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28617 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:50:21.492269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-424859364", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "0e8d58a1-9518-45ad-8e30-37b570122f7b"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:21.727635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] validate_networks() for [('0e8d58a1-9518-45ad-8e30-37b570122f7b', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:50:21.736194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:21.737007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:21.757686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:21.758190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:21.765358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:21.768515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:22.447255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:22.472803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fad1bac7-924a-41c1-a1c2-a5956b37d791 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.778400 Dec 02 15:50:22.482841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 163/344] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:21 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:22.514941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:22.517272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:22.544217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:22.544970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:22.545571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:22.546819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:22.796564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dcf341d0-044f-4905-aad4-5e2357dd3750 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28579 microversion: 2.20 time: 0.310161 Dec 02 15:50:22.803937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 164/345] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:22 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28579 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:22.897467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:22.906064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:22.928765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:22.936228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:22.939187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:22.942479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.128077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:50:23.128567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:50:23.129119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:50:23.129593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:50:23.130070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:50:23.150064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dfd84748-e696-45ae-8e5b-9cc49a588a97 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28617 microversion: 2.1 time: 0.323265 Dec 02 15:50:23.152738 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 165/346] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:22 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28617 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:23.158537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.159060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.160017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.160534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.177181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:23.177984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:23.193503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.194947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.196894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.209328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.231318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:50:23.243453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Getting quotas for user 792f7ff55fec492a8cf35f9e27c85210 and project bf0ccd282f4042c2af3ebf05183275c7. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:50:23.265887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:50:23.269319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:50:23.430731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:50:23.526122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b736b62b-b014-4394-b187-b78f64579e86 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.046831 Dec 02 15:50:23.527895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 182/347] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:50:21 2020] POST /compute/v2.1/servers => generated 382 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:50:23.550657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:23.551924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:23.569696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.571033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.574959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.576221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.846288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7f591ecd-a6f8-45c1-9e8f-cefb25296c29 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "DELETE /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 204 len: 0 microversion: 2.1 time: 0.690879 Dec 02 15:50:23.847054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 166/348] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:50:23 2020] DELETE /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:50:23.880119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-816c652a-6f91-4b94-940e-eefc0e1b697a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:23.882685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-816c652a-6f91-4b94-940e-eefc0e1b697a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:23.941996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:23.954583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af2463bb-70e9-4eb7-99da-8fcc521ba99c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.424703 Dec 02 15:50:23.955231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 183/349] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:23 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:23.967401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:23.969299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:23.988927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.988927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:23.989622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:23.990769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:24.038534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-816c652a-6f91-4b94-940e-eefc0e1b697a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:24.060728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-816c652a-6f91-4b94-940e-eefc0e1b697a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1221 microversion: 2.1 time: 0.211650 Dec 02 15:50:24.106260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 167/350] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:23 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:24.106260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:24.106260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:24.120789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:24.122190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:24.125136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:24.125968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:24.190590 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7376e52e-1166-4fef-a9ba-b0d6ed10c13b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28579 microversion: 2.20 time: 0.233860 Dec 02 15:50:24.192545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 184/351] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:23 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28579 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:24.208808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:24.212568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:24.230308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:24.231166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:24.237912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:24.237912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:24.467117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:24.498615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-051f521d-9780-4f8d-93ba-dfd5e01c61f2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28617 microversion: 2.1 time: 0.303305 Dec 02 15:50:24.510838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-697b06e2-f8ee-44d5-8ddf-8aa4b6a20299 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1506 microversion: 2.1 time: 0.440282 Dec 02 15:50:24.514613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 168/352] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:24 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:24.521740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 185/353] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:24 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28617 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:25.021359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:25.022808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:25.038115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.039295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.050375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.051183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.150034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:25.157725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:25.180410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.181376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.182826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.183573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.476476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:25.490579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-edb0eb07-8954-4d09-9c80-1792dcc6d0ff tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.514121 Dec 02 15:50:25.491266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 169/354] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:24 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:25.517000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:25.518156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:25.524731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:25.527182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.528034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.529240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.529739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.542644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42cf4027-eb4e-4a83-ab9d-69160686d862 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1225 microversion: 2.1 time: 0.407480 Dec 02 15:50:25.544052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 186/355] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:25 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1225 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:25.568261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:25.570264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:25.594043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.594486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.595406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.595907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.813904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-949317bf-97d5-431e-9df4-7f3c6bde3d9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28579 microversion: 2.20 time: 0.308226 Dec 02 15:50:25.821691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 170/356] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:25 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28579 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:25.842808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:25.844894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:25.865084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.866334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.868003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:25.868909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:25.934028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4cb47090-077f-4611-b581-d3b592c5e322 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28617 microversion: 2.1 time: 0.388247 Dec 02 15:50:25.934861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 187/357] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:25 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28617 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:26.232500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:26.244725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9292b1a4-f88f-4241-a2e3-ff95306b5f6b tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1506 microversion: 2.1 time: 0.427013 Dec 02 15:50:26.245692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 171/358] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:25 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:26.518339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:26.519171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:26.529142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:26.529720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:26.531257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:26.531826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:26.579402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:26.580751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:26.595959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:26.596881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:26.598454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:26.599373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:26.874463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:26.903026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-837dabdf-36ff-4f2a-a3ea-4a6f2efbccea tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1273 microversion: 2.1 time: 0.336600 Dec 02 15:50:26.903893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 172/359] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:26 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:26.934585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:26.935876 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:26.957277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:26.962491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:26.963763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:26.967380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.029956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:27.073567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3c05449c-0c9a-40bf-97ef-256b0b0d9db3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.563234 Dec 02 15:50:27.074560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 188/360] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:26 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:27.123250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:27.125248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:27.143594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.144224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.145096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.145585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.250899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-813ffd5b-93d6-43df-b138-74f1e0d42756 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28579 microversion: 2.20 time: 0.343168 Dec 02 15:50:27.253405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 173/361] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:26 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28579 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:27.309791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:27.320148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:27.367163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.367786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bf884db7-a27f-49a0-be7f-cb3d2c526012 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 28617 microversion: 2.1 time: 0.290188 Dec 02 15:50:27.368640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 189/362] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:27 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 28617 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:27.368929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.370970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.372251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.675728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-49a4484a-b7c5-4d75-a1c0-0b044688a3b4 req-3a80cd47-802d-4fd5-8954-a31cec3c73ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1057858-aa53-42ac-8b43-08a1c748f79c", "name": "network-vif-unplugged", "status": "completed", "tag": "83b04747-0785-4468-a620-adb9e32ec302"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:27.682684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:50:27.682684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:50:27.699048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-49a4484a-b7c5-4d75-a1c0-0b044688a3b4 req-3a80cd47-802d-4fd5-8954-a31cec3c73ab service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.700788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-49a4484a-b7c5-4d75-a1c0-0b044688a3b4 req-3a80cd47-802d-4fd5-8954-a31cec3c73ab service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.782746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-49a4484a-b7c5-4d75-a1c0-0b044688a3b4 req-3a80cd47-802d-4fd5-8954-a31cec3c73ab service nova] Creating event network-vif-unplugged:83b04747-0785-4468-a620-adb9e32ec302 for instance a1057858-aa53-42ac-8b43-08a1c748f79c on hv-cinder-73761 Dec 02 15:50:27.793741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-49a4484a-b7c5-4d75-a1c0-0b044688a3b4 req-3a80cd47-802d-4fd5-8954-a31cec3c73ab service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128054 Dec 02 15:50:27.802382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 190/363] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:50:27 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:50:27.960073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:27.963576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:27.989807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.990714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:27.993392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:27.994409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.260450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:28.282396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cd6d4946-e0e1-4380-a420-4b03ef49b758 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1506 microversion: 2.1 time: 1.005084 Dec 02 15:50:28.284686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 174/364] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:27 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1506 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:28.317405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:28.319433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:28.322400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:28.337334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b32af979-d32c-4259-82d2-6dbeb00fff5e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1279 microversion: 2.1 time: 0.400681 Dec 02 15:50:28.348092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 191/365] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:27 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1279 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:28.353400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:28.354400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.355716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:28.356825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.393783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:28.395883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:28.438050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:28.439408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.449815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:28.451164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.701745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bfa5b6e5-8275-4131-9a7a-e9398cafc1c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 28700 microversion: 2.20 time: 0.360856 Dec 02 15:50:28.709964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 192/366] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:28 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 28700 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:28.726702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:28.749502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:28.763912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:28.764590 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.766403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:28.766879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:28.928890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:28.948247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-269f5578-b0f2-4092-aef1-232fdc040acc tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.661164 Dec 02 15:50:28.952113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 175/367] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:28 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:29.058914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a1df83e9-2185-492f-a960-49575ee26f70 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 29987 microversion: 2.1 time: 0.352849 Dec 02 15:50:29.062499 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 193/368] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:28 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 29987 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:29.318971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:29.320375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:29.333035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:29.333819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:29.334932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:29.335894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:29.381730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:29.383683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:29.403734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:29.404281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:29.405307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:29.406190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:29.603643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:29.622595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b2ae1e47-8c88-4163-bc9a-9330688aa5b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1279 microversion: 2.1 time: 0.267314 Dec 02 15:50:29.623940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 194/369] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:29 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:29.748694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:29.751523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:29.768703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:29.769637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:29.771156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:29.772078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:30.013580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bfede6e5-8c85-4be1-8714-a2a39000419e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 29965 microversion: 2.20 time: 0.297603 Dec 02 15:50:30.016325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 195/370] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:29 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 29965 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:30.031001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:30.032873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:30.055852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:30.057016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:30.059171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:30.060214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:30.445622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:30.462060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dbb6d1ab-43ee-459c-b4c9-858f0ead77af tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.442425 Dec 02 15:50:30.463127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 196/371] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:30 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:30.476505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:30.477811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:30.494508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:30.494508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:30.501161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:30.501685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:30.758692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-77641ae5-f1fa-405b-8d21-3d0970671801 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 31524 microversion: 2.1 time: 0.287582 Dec 02 15:50:30.766647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 197/372] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:30 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 31524 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:30.774762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:30.801063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:30.802259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:30.806300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a9b1a288-bcc3-4e75-8f28-382389a898a2 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1506 microversion: 2.1 time: 1.498950 Dec 02 15:50:30.808237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 176/373] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:29 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1506 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:30.817319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:30.818355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:30.819548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:30.820218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.038980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:31.040457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:31.053568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.054594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.055818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.056604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.156946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:31.184472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-312a942e-848e-4392-8c3b-0735e8cc8e7d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.407586 Dec 02 15:50:31.184472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 198/374] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:30 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:31.333866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-740247fa-7a60-4649-90e8-497c28d9acc7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 31087 microversion: 2.20 time: 0.308039 Dec 02 15:50:31.340856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 177/375] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:31 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 31087 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:31.528383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:31.529969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:31.539098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.539708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.540800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.541371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.785965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:31.787148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:31.796528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.802484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.802484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.802484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.820187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:31.839010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d51cc99e-78ac-4932-80d1-f50263bbd700 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.350574 Dec 02 15:50:31.856611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 199/376] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:31 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:31.889073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:31.890663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:31.927653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.929108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:31.931595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:31.932567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.173120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:32.182486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1d852da6-7def-4e0f-a1d5-cffebef9e42c tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1464 microversion: 2.1 time: 0.321387 Dec 02 15:50:32.183378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 200/377] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:31 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:32.209965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-32b7917f-4cfe-4800-b43e-dbb0583823c3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 32269 microversion: 2.1 time: 0.435884 Dec 02 15:50:32.210580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 178/378] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:31 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 32269 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:32.220604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:32.221284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:32.230368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.230888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.231790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.232323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.357405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:32.359282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:32.387083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.387599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.388543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.389050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.630879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a84f454d-aa9f-4bbb-89cd-242ad429c6ef tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 32148 microversion: 2.20 time: 0.283299 Dec 02 15:50:32.633881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 179/379] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:32 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 32148 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:50:32.646692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-4ead24b7-f3b4-4dbc-af27-f380a8e6fe50 req-5591590f-ca4d-4e7d-a54a-53e79d0ffc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1057858-aa53-42ac-8b43-08a1c748f79c", "name": "network-vif-deleted", "tag": "83b04747-0785-4468-a620-adb9e32ec302"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:32.655244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:50:32.655244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:50:32.670670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-4ead24b7-f3b4-4dbc-af27-f380a8e6fe50 req-5591590f-ca4d-4e7d-a54a-53e79d0ffc33 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.679023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-4ead24b7-f3b4-4dbc-af27-f380a8e6fe50 req-5591590f-ca4d-4e7d-a54a-53e79d0ffc33 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.683108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:32.695564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b869c285-60d2-4e65-b66e-cad0ee82100e tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.489612 Dec 02 15:50:32.696357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 201/380] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:32 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:32.705137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-4ead24b7-f3b4-4dbc-af27-f380a8e6fe50 req-5591590f-ca4d-4e7d-a54a-53e79d0ffc33 service nova] Creating event network-vif-deleted:83b04747-0785-4468-a620-adb9e32ec302 for instance a1057858-aa53-42ac-8b43-08a1c748f79c on hv-cinder-73761 Dec 02 15:50:32.712696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-4ead24b7-f3b4-4dbc-af27-f380a8e6fe50 req-5591590f-ca4d-4e7d-a54a-53e79d0ffc33 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076432 Dec 02 15:50:32.713904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 180/381] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:50:32 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:32.883681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:32.886313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:32.916384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.916384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:32.916384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:32.916384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.230531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:33.231345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:33.241337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.241859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.242798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.243303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.370101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.375536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:33.376366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.377189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lazy-loading 'fault' on Instance uuid a1057858-aa53-42ac-8b43-08a1c748f79c {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:50:33.399935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a4a62b80-b458-4806-bbb5-28dcdae04688 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.525471 Dec 02 15:50:33.402049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 202/382] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:32 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:33.435829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:33.441000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:33.459054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.460472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.462687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.464162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.586509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c69aacc8110b4aaf93aaebe8d1ce6fa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c9112430664980ab7f1093238878e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:33.621733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b04c8360-c2df-4315-b5b4-b0e62de454f5 tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 200 len: 1306 microversion: 2.1 time: 0.421468 Dec 02 15:50:33.623085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 181/383] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:33 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 1306 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:33.692350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:33.694351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:33.732688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.733757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.735296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.736290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.778831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e211c220-df00-43aa-9a39-65a01a8b9e9c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 32991 microversion: 2.1 time: 0.373866 Dec 02 15:50:33.786078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 203/384] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:33 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 32991 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:33.794332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:33.795147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:33.821500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.821945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:33.830340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:33.830870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.028022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ced3183b-d2b2-489e-a1bf-dfea57abac2d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 33008 microversion: 2.20 time: 0.382391 Dec 02 15:50:34.036642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 182/385] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:33 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 33008 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:34.462655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:34.467441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:34.499510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:34.510998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.511311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c979be01-1e4a-4077-bb43-03a0c92148a1 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.729616 Dec 02 15:50:34.511879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 204/386] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:33 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:34.513757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.517856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.518811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.675644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:34.677572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] [instance: a1057858-aa53-42ac-8b43-08a1c748f79c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:34.695304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.696929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.698958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.705974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.869289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] HTTP exception thrown: Instance a1057858-aa53-42ac-8b43-08a1c748f79c could not be found. Dec 02 15:50:34.870953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] Returning 404 to user: Instance a1057858-aa53-42ac-8b43-08a1c748f79c could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:50:34.875015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e59b5e47-d2ac-48f2-88a2-21aa90c1e90e tempest-VolumesActionsTest-1046407281 tempest-VolumesActionsTest-1046407281] 10.222.0.101 "GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c" status: 404 len: 111 microversion: 2.1 time: 0.225513 Dec 02 15:50:34.885143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 205/387] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:34 2020] GET /compute/v2.1/servers/a1057858-aa53-42ac-8b43-08a1c748f79c => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:50:34.893806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-141c33d9-3f30-476b-a374-38ba658f97e3 req-080f36d9-43b0-4b2c-aa94-1e6add02dd09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05bbe402-38cd-467a-96c3-06e18c8a07a1", "tag": "edf35ac9-cb62-4d61-b8c4-dc1b5ed92a6c"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:34.902229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:50:34.902229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:50:34.913989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-141c33d9-3f30-476b-a374-38ba658f97e3 req-080f36d9-43b0-4b2c-aa94-1e6add02dd09 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.914666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-141c33d9-3f30-476b-a374-38ba658f97e3 req-080f36d9-43b0-4b2c-aa94-1e6add02dd09 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.944015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-141c33d9-3f30-476b-a374-38ba658f97e3 req-080f36d9-43b0-4b2c-aa94-1e6add02dd09 service nova] Creating event network-changed:edf35ac9-cb62-4d61-b8c4-dc1b5ed92a6c for instance 05bbe402-38cd-467a-96c3-06e18c8a07a1 on hv-cinder-73761 Dec 02 15:50:34.949840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-141c33d9-3f30-476b-a374-38ba658f97e3 req-080f36d9-43b0-4b2c-aa94-1e6add02dd09 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072219 Dec 02 15:50:34.956275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 206/388] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:50:34 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:34.969759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:34.970922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:34.988746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.993502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:34.996647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:34.997477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:35.447058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4f91377f-eacc-4582-b249-4d85f7f09d7b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 33759 microversion: 2.1 time: 0.488198 Dec 02 15:50:35.447776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 207/389] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:34 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 33759 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:35.464591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:35.466046 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:35.475913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:35.476459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:35.477322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:35.477808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:35.534503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:35.550032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-810e37bb-760c-4dc6-b344-a6bf2718e44e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 1.126091 Dec 02 15:50:35.564010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 183/390] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:34 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:35.583484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:35.584392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:35.595629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:35.596142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:35.600277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:35.600944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:35.865182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6520cb58-e5dc-4e66-8592-7313ea56a422 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 33696 microversion: 2.20 time: 0.414618 Dec 02 15:50:35.872492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 208/391] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:35 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 33696 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:36.483484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:36.485277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:36.500234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:36.501636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:36.503279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:36.504525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:36.512366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:36.538448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e58dae6b-e3fe-4c35-81cc-2f247c22bd83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.985528 Dec 02 15:50:36.539591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 184/392] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:35 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:36.616619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:36.617501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:36.628403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:36.629385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:36.629838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:36.630338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:36.803279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-58e3aa7f-6011-4ee8-99c6-163b92ac9369 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 34596 microversion: 2.1 time: 0.334438 Dec 02 15:50:36.806315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 209/393] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:36 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 34596 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:36.913220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:36.915390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:36.933057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:36.933897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:36.935493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:36.936995 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:37.073138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:37.101667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-03bb7d68-577c-47b7-ab0a-46740b57057a tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.522960 Dec 02 15:50:37.128164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 185/394] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:36 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:37.363252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42e03ccd-e7d3-432d-971d-aed2e1507993 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 34286 microversion: 2.20 time: 0.483527 Dec 02 15:50:37.365214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 210/395] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:36 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 34286 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:37.579264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:37.579932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:37.603647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:37.604675 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:37.605935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:37.606610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:37.885276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:37.889607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:37.922761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:37.923743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:37.925424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:37.926656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:38.263028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-99b9bb29-ce53-47b1-a67b-fdc5f9ecefe1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 35389 microversion: 2.1 time: 0.438012 Dec 02 15:50:38.265255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 211/396] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:37 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 35389 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:50:38.291010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:38.292157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:38.303860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:38.304536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:38.305583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:38.306159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:38.527956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:38.545661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fad47e96-d97f-4329-90e7-30c8a98d53b4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.979342 Dec 02 15:50:38.547057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 186/397] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:37 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:38.577964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:38.579927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:38.596243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:38.597174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:38.598768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:38.599684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:38.641132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:38.657961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-db010c8e-1216-408c-a50b-b2380e19edcf tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.390475 Dec 02 15:50:38.659041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 212/398] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:38 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:39.286356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:39.287863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:39.299684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:39.300616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:39.303959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:39.303959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:41.838161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ea9fb5bc-5e54-44d1-a32b-4493cb168595 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 37605 microversion: 2.1 time: 2.564242 Dec 02 15:50:41.839004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 213/399] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:39 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 37605 bytes in 2567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:41.852009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:41.852864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:41.862821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:41.863334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:41.864333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:41.864833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:41.884965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4bb39475-261b-4acd-a9d2-e7cb669e62a8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 37674 microversion: 2.20 time: 3.335659 Dec 02 15:50:41.885975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 187/400] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:38 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 37674 bytes in 3338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:41.900502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:41.901271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:41.911003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:41.911507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:41.912402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:41.912897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:42.204725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:42.224415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:42.224715 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6726c5bf-e9fb-4138-9b45-39a4d3a1ab9a tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.383261 Dec 02 15:50:42.225705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 214/401] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:41 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:42.236414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-40422a38-3a5c-4c84-87c9-5e146a793cea tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.348523 Dec 02 15:50:42.237166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 188/402] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:41 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:42.858510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:42.859565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:42.869763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:42.870275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:42.871362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:42.871609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:42.916538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:42.918172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:42.935376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:42.937241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:42.938528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:42.939400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:43.165774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3b97f8f3-7c54-4a0a-8106-df5f8defc8b8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 38062 microversion: 2.1 time: 0.316211 Dec 02 15:50:43.167162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 215/403] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:42 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 38062 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:43.254556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:43.256774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:43.259462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-141da50d-5ea5-4e6f-81d7-560907cead7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 38096 microversion: 2.20 time: 0.361174 Dec 02 15:50:43.260920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 189/404] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:42 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 38096 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:43.273884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:43.275401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:43.276200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:43.276725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:43.277201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:43.277810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:43.288595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:43.289326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:43.290411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:43.290955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:43.615739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:43.635363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-33e01089-b3d6-46a8-84db-959788cf8a1f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 0.392830 Dec 02 15:50:43.637070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 216/405] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:43 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:43.707370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:43.718254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0e617572-f3f8-46ee-af2f-b437176c4629 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.454497 Dec 02 15:50:43.719201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 190/406] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:43 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:44.207589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:44.215631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:44.261355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.262744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.266643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.271350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.325057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:44.331333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:44.359070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.359865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.361558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.367648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.616465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-aa6952f5-7f83-46a0-b519-5045672a5029 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 38149 microversion: 2.1 time: 0.436015 Dec 02 15:50:44.617719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 217/407] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:44 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 38149 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:44.661254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-85b444ec-4cc4-4916-a053-9b49d7e27c5e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 38096 microversion: 2.20 time: 0.385210 Dec 02 15:50:44.662690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 191/408] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:44 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 38096 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:50:44.702673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:44.713946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:44.759232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.760323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.762150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.763146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.768287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:44.771913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:44.789330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.789999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:44.791176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:44.792215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.185332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:45.200258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-df3e7234-fa65-4d43-bd2d-7b5967ad5c98 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1506 microversion: 2.1 time: 0.462188 Dec 02 15:50:45.219874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 192/409] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:44 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1506 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:45.254213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b05206a-89f7-47f6-b558-37748afb434c"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:45.257407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:45.278935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:45.282755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.284916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:45.285961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.563262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] HTTP exception thrown: Cannot 'attach_volume' instance 151ef38d-ba70-4859-93d6-24b1aad15e27 while it is in vm_state rescued Dec 02 15:50:45.563262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Returning 409 to user: Cannot 'attach_volume' instance 151ef38d-ba70-4859-93d6-24b1aad15e27 while it is in vm_state rescued {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:50:45.564617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c898ee64-9705-461e-9227-ec41437ddb70 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.329426 Dec 02 15:50:45.570742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 193/410] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:50:45 2020] POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments => generated 152 bytes in 332 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 02 15:50:45.605574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:45.606258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:45.624372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:45.624994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.626500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:45.627092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.730095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:45.797089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7c179b91-258a-4502-8edc-b53c916ed0d0 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 1.121489 Dec 02 15:50:45.798356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 218/411] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:44 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:45.864328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:45.868700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:45.895522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:45.898069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.898069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:45.898968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:45.934837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-620ddc8c-96c2-4c5b-8947-a75784caaebd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action" status: 202 len: 0 microversion: 2.1 time: 0.352302 Dec 02 15:50:45.937058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 194/412] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:45 2020] POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:45.975988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:45.977974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:46.002711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.003605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.005199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.006543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.182160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-90c793c7-6c4c-4e73-b6de-1ea0f9a3f493 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 200 len: 38212 microversion: 2.1 time: 0.367914 Dec 02 15:50:46.189537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 219/413] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:50:45 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 38212 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:46.230213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:46.245935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:46.281664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.296905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.298258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.298924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.393630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3e2403eb-3193-4b4f-b898-9f22980057e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 200 len: 38239 microversion: 2.20 time: 0.450076 Dec 02 15:50:46.394387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 195/414] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:45 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 38239 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:50:46.415276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:46.415556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:46.436491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.440681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.442367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.442883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.644306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-82088c8d-295a-48cb-93ac-273af5bc5c05 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/ips" status: 200 len: 145 microversion: 2.1 time: 0.241494 Dec 02 15:50:46.646100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 196/415] 10.222.0.101 () {58 vars in 1243 bytes} [Wed Dec 2 15:50:46 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/ips => generated 145 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:46.669882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:46.671360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:46.690719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.692224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.694228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:46.695540 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:46.963603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ef9d483b-c09b-4141-be1b-fc3fbd446477 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/ips" status: 200 len: 152 microversion: 2.20 time: 0.314752 Dec 02 15:50:46.964836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 197/416] 10.222.0.101 () {60 vars in 1284 bytes} [Wed Dec 2 15:50:46 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/ips => generated 152 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:50:47.007556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-20285ea4-564c-492f-af57-4b4b623014e9 req-2554a5fc-a81d-456b-9a49-b470fbdc480a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05bbe402-38cd-467a-96c3-06e18c8a07a1", "name": "network-vif-plugged", "status": "completed", "tag": "edf35ac9-cb62-4d61-b8c4-dc1b5ed92a6c"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:47.067187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:50:47.067187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:50:47.131837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-20285ea4-564c-492f-af57-4b4b623014e9 req-2554a5fc-a81d-456b-9a49-b470fbdc480a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:47.153216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-20285ea4-564c-492f-af57-4b4b623014e9 req-2554a5fc-a81d-456b-9a49-b470fbdc480a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:47.232062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-20285ea4-564c-492f-af57-4b4b623014e9 req-2554a5fc-a81d-456b-9a49-b470fbdc480a service nova] Creating event network-vif-plugged:edf35ac9-cb62-4d61-b8c4-dc1b5ed92a6c for instance 05bbe402-38cd-467a-96c3-06e18c8a07a1 on hv-cinder-73761 Dec 02 15:50:47.257290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-20285ea4-564c-492f-af57-4b4b623014e9 req-2554a5fc-a81d-456b-9a49-b470fbdc480a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.290128 Dec 02 15:50:47.258742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 198/417] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:50:46 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:47.298444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:47.300442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:47.333429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:47.334807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:47.336805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:47.344479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:47.710005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:47.747145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3fbe74a9-e1d6-4c18-8ed3-92d7399a787c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1514 microversion: 2.1 time: 1.552257 Dec 02 15:50:47.753889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 220/418] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:46 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1514 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:48.790412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:48.791308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:48.825889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:48.829909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:48.833457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:48.840808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:49.871079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:49.903850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3a96e74a-d100-41c6-a4ae-48f2d0821844 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 2.642704 Dec 02 15:50:49.920115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 199/419] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:47 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 2660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:50.147652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:50.181762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a63ef3ef-89ae-4280-bc3c-090c9be721a5 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1514 microversion: 2.1 time: 1.411661 Dec 02 15:50:50.184454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 221/420] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:48 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1514 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:50.973845 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:50.974623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:50.987559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:50.988141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:50.990186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:50.991488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:51.112544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0b02786-a75d-44b1-ac01-8eb2e421151b"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:51.134174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:51.165031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:51.166103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:51.168317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:51.170681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:51.917485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:51.980432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-07d0a4c9-88e0-4f18-a994-ae4847f900fb tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1321 microversion: 2.1 time: 1.015046 Dec 02 15:50:51.980432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 200/421] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:50 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1321 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:52.003375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:52.005831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:52.024920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:52.026698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:52.028690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:52.030391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:52.533488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d25d953f-c211-4fe4-802d-412202443314 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.498096 Dec 02 15:50:52.534308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 222/422] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:50:51 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/os-volume_attachments => generated 194 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:50:52.539849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:52.572834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c4fbd0d-9112-4463-b96c-3886f87ea50d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1514 microversion: 2.1 time: 0.606305 Dec 02 15:50:52.574204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 201/423] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:51 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1514 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:52.600659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:52.601434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:52.617918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:52.618737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:52.619795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:52.620547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:52.785043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lazy-loading 'flavor' on Instance uuid a5112b52-9227-41cf-a36c-19e97dd4222c {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:50:52.990321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:52.997215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:53.026924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:53.034484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:53.034484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:53.034484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:54.543055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:54.563409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6185acf7-714e-4c78-846d-cd5a4fb49bd6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1510 microversion: 2.1 time: 1.583692 Dec 02 15:50:54.564908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 202/424] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:52 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1510 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:50:54.621910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:54.638454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:54.662631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b5b97946-90fc-4a06-b14c-74d84786d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 202 len: 0 microversion: 2.20 time: 2.126016 Dec 02 15:50:54.663520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 223/425] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:50:52 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 0 bytes in 2128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:50:54.678535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:54.678944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:54.679820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:54.680345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:54.693925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:54.694716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:54.742337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:54.743233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:54.745127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:54.746014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:55.590889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:55.609680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:55.634915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ea74eaaf-3c09-4cb8-a66c-0d30d7270697 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1520 microversion: 2.1 time: 1.067877 Dec 02 15:50:55.636060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 203/426] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:54 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1520 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:55.658534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:55.719833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:55.722917 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4e9e6da8-a1ea-4df5-8346-c33746f61699 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 1.050613 Dec 02 15:50:55.729056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 224/427] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:50:54 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:50:56.789110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:56.794650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:56.838000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:56.838691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:56.839933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:56.841230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:57.243749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:57.289236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:57.334136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:57.334719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1d90d210-4b48-4d4a-aea8-79c8a9669b65 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 0.577648 Dec 02 15:50:57.335363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 204/428] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:50:56 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:50:57.779940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "345f9c8f-6692-40ba-9ac4-a53fa27437b9"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:57.782057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:57.795161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:57.796316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:57.797396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:57.798076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:58.263927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:58.273801 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:58.298921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:58.306041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:58.308169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:58.309463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:58.946394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:58.980519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6a9df112-4aad-43e3-96db-dc0f46758608 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1520 microversion: 2.1 time: 0.773290 Dec 02 15:50:58.985050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 205/429] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:50:58 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1520 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:50:59.032334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:50:59.033614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:59.082942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:59.083864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:59.085350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:59.086546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:59.609714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a63ce01e-b8f6-4934-9dcc-beffd68b06c4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "POST /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.857134 Dec 02 15:50:59.611053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 225/430] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:50:57 2020] POST /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1/os-volume_attachments => generated 194 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:50:59.672484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fa36f27-ce90-4f85-93ad-f230d2327f45"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:50:59.675692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:50:59.698807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:59.699676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:59.701895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:50:59.702787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:50:59.848533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:59.957201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:50:59.986151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:00.001037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0ed4dc58-fc95-45ad-9811-29f4361aeac6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 1.014004 Dec 02 15:51:00.005683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 206/431] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:50:58 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:00.645681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1657230811", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "5072836c-1689-4769-8096-b0a206a7686f"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:00.850898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] validate_networks() for [('5072836c-1689-4769-8096-b0a206a7686f', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:51:01.707451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c0d58b5-1ca2-462f-86d6-cfcca0434434 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.093729 Dec 02 15:51:01.719712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 226/432] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:50:59 2020] POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments => generated 194 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:01.782758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:01.803816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:01.826983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:01.828274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:01.830635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:01.831461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:02.289233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:02.311197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:02.318604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:02.320130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-237ff0f7-c404-4bd2-afc9-3b4666dfc1ca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 0.598040 Dec 02 15:51:02.321035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 227/433] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:01 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:02.378729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:51:02.380269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:51:02.381959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:51:02.382993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:51:02.384053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:51:02.431220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:02.433390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:02.435962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:02.444243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:02.525212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Getting quotas for project 229596ae42204d5ead3f32ea7ab04bad. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:51:02.533160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Getting quotas for user 361cc487f5a44c18b7c365738b6e4ccc and project 229596ae42204d5ead3f32ea7ab04bad. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:51:02.557048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:51:02.564000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:51:02.627956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3b31ba4b-34a0-4757-992f-f807b65e672f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:02.644576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b31ba4b-34a0-4757-992f-f807b65e672f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:02.645512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b31ba4b-34a0-4757-992f-f807b65e672f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:02.737966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3b31ba4b-34a0-4757-992f-f807b65e672f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Going to try to stop instance {{(pid=94390) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 02 15:51:02.806224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-02eb43fd-5156-4efa-b5db-83306fbf2188 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.177425 Dec 02 15:51:02.811955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 207/434] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:51:00 2020] POST /compute/v2.1/servers => generated 382 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:51:02.879661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a4806696-1c0a-488e-9165-aba17f1ab105 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:02.881382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a4806696-1c0a-488e-9165-aba17f1ab105 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:03.018438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3b31ba4b-34a0-4757-992f-f807b65e672f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.406277 Dec 02 15:51:03.019485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 228/435] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:51:02 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:51:03.045697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:03.046609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:03.074504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:03.075017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:03.076316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:03.077467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:03.306899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a4806696-1c0a-488e-9165-aba17f1ab105 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:03.392239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a4806696-1c0a-488e-9165-aba17f1ab105 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1223 microversion: 2.1 time: 0.558388 Dec 02 15:51:03.394972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 208/436] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:02 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1223 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:03.419057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:03.424025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:03.449013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:03.452028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:03.453097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:03.454660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:04.117230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:04.130873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-88383fac-1f64-435f-9921-c275652866d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 1.105134 Dec 02 15:51:04.139709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 229/437] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:03 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:04.327506 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:04.398806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:04.424822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:04.427724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-999c0bd0-e0c3-4b1b-bdd2-9d80313574f7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 1.030966 Dec 02 15:51:04.429259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 209/438] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:03 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:04.445471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d691a5fe-dcdb-48dc-925d-51a5cdffce75 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:04.449365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d691a5fe-dcdb-48dc-925d-51a5cdffce75 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:04.696839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d691a5fe-dcdb-48dc-925d-51a5cdffce75 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:04.719779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d691a5fe-dcdb-48dc-925d-51a5cdffce75 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1223 microversion: 2.1 time: 0.298956 Dec 02 15:51:04.720446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 230/439] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:04 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1223 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:05.206845 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:05.218375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:05.272414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:05.272939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:05.276898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:05.277474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:05.455527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:05.456266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:05.482330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:05.484537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:05.484537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:05.484537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:05.801781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:05.830326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-80b0617b-bfa5-4065-976c-c818aaa10a54 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.674372 Dec 02 15:51:05.853108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 210/440] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:05 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:05.870911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:05.880509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:05.895848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:05.896403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:05.897319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:05.897834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:06.322709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:06.362721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-26823f8c-da85-4a3b-a3f7-168d9fe613f1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1275 microversion: 2.1 time: 0.507987 Dec 02 15:51:06.363799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 211/441] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:05 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1275 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:06.659863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:06.680854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:06.688125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:06.689682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-23ca3699-f02a-448a-88ef-05769ce59922 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 1.244050 Dec 02 15:51:06.690531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 231/442] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:05 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:06.897953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:06.899163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:06.917924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:06.917924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:06.918300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:06.921210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:07.416132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:07.417014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:07.444470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:07.444985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:07.445861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:07.446354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:07.662505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:07.674546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dcdd8fce-9fc1-48ab-8d59-771dc4e21838 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1281 microversion: 2.1 time: 0.278990 Dec 02 15:51:07.675630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 232/443] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:07 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1281 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:07.715370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:07.717075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:07.745982 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:07.746496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:07.747574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:07.748099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:08.278201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:08.303137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:08.313408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:08.314682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ca4662e6-7112-4cb1-934f-759d85fd68f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 0.609744 Dec 02 15:51:08.315377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 233/444] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:07 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:51:08.429261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:08.491226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fb1f3222-733a-4d05-8fca-824709f5587e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 1.624521 Dec 02 15:51:08.502928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 212/445] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:06 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:08.719386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:08.720099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:08.728968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:08.729491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:08.730364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:08.730848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:09.086212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:09.113990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e9b0779-ec7c-4e41-b3a9-8774946551c8 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1281 microversion: 2.1 time: 0.414420 Dec 02 15:51:09.114842 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 234/446] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:08 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1281 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:09.345589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:09.346579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:09.359522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:09.364369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:09.364369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:09.364369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:09.520595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:09.522148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:09.537486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:09.538320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:09.540786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:09.541513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:10.292919 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:10.343623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2417dc93-5d45-496e-bfb1-227190607139 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.834888 Dec 02 15:51:10.352416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 235/447] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:09 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:10.377024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:10.381584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:10.398434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:10.399168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:10.405159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:10.405950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:10.802437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:10.825947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fdb6b847-0694-49e6-af38-126b4269f36e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1281 microversion: 2.1 time: 0.471741 Dec 02 15:51:10.828217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 236/448] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:10 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:10.974910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:10.981920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:11.088103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:11.089645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:11.094089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:11.100211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:11.723879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-743d4294-2a9a-4e5e-b260-eda638b9da3b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1/os-volume_attachments/345f9c8f-6692-40ba-9ac4-a53fa27437b9" status: 202 len: 0 microversion: 2.1 time: 0.811581 Dec 02 15:51:11.725018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 237/449] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:51:10 2020] DELETE /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1/os-volume_attachments/345f9c8f-6692-40ba-9ac4-a53fa27437b9 => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:51:11.745967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:11.746806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:11.776215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:11.776740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:11.777626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:11.778145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:12.295606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:12.311031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6c7e5f9f-a52d-4633-a986-d9e2ae132e28 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.580760 Dec 02 15:51:12.328442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 238/450] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:11 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:12.357829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:12.359599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:12.376405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:12.377192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:12.379825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:12.380775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:12.714284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:12.723238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:12.735308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bb1746e2-6fa4-474a-b160-6ec671f16f11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1281 microversion: 2.1 time: 0.405059 Dec 02 15:51:12.736427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 239/451] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:12 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1281 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:12.744303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:12.756580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:12.758353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-94211159-65e5-4f78-807e-e91ec30fb6bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 3.427233 Dec 02 15:51:12.759768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 213/452] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:09 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 3429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:51:13.391502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:13.393423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:13.438073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:13.438988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:13.445226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:13.446455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:13.787661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:13.789098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:13.822044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:13.822846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:13.831380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:13.837207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:14.081426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:14.096592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-66840579-7590-463e-8286-107b60c7a8ec tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.761878 Dec 02 15:51:14.097474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 240/453] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:13 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:14.107945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:14.108557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:14.117210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:14.117707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:14.118587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:14.119077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:14.506091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:14.525484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:14.534177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:14.535833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6c6b6805-1ff7-4d23-8b00-5e07644a62e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 0.437512 Dec 02 15:51:14.536756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 241/454] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:14 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:15.124157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:15.131421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:15.155884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:15.156856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:15.158195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:15.158971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:15.482702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:15.520268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6d4f86bc-7dee-42b1-a11d-ae1582b66506 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 1.770159 Dec 02 15:51:15.521244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 214/455] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:13 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:15.579883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:15.592602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:15.611913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:15.612480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:15.613323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:15.613994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:15.772493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:15.814088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a70acf4e-e570-46dd-904f-a9219fdb7612 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.701401 Dec 02 15:51:15.835741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 242/456] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:15 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:16.544857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:16.545624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:16.554276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:16.554778 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:16.555644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:16.556199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:16.665030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:16.681187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:16.689416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:16.690653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2832d8ea-0bb7-4b8a-a907-91695fdf8b2f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 1.134614 Dec 02 15:51:16.691485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 215/457] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:15 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:16.846202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:16.846877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:16.855853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:16.856769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:16.857707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:16.858201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:17.149287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:17.173931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-30a6a92c-ac5f-442c-afd2-8d56d60edb7f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 0.634564 Dec 02 15:51:17.177719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 243/458] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:16 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:17.581239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:17.622858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e7d549d4-50cb-4079-8b1d-35e2163bc531 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.786743 Dec 02 15:51:17.624547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 216/459] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:16 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:17.739681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:17.740397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:17.751435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:17.752059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:17.753149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:17.753678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:18.223089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:18.229018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:18.261199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:18.269559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:18.271127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:18.271765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:18.381719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:18.520097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:18.545384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:18.553523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dbd4630c-224e-42f1-98dc-4a221a6526aa tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 0.828575 Dec 02 15:51:18.553523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 244/460] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:17 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:51:18.676086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:18.689909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:18.733798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:18.738395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:18.742842 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:18.746200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:20.060522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:20.169641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-99a558b5-686d-4bfb-9334-bd9216de0974 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 1.513181 Dec 02 15:51:20.204468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 245/461] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:18 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:20.263215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:20.266572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:20.302982 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:20.304940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:20.315517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:20.316766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:20.657902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lazy-loading 'flavor' on Instance uuid 151ef38d-ba70-4859-93d6-24b1aad15e27 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:51:21.657961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:21.686620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-afd5ce71-9b76-4fe2-a0e5-519e54c13f2a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 3.483024 Dec 02 15:51:21.687636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 217/462] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:18 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 3489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:21.719999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-57120bee-228f-4a44-9489-272d88a6d305 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action" status: 200 len: 32 microversion: 2.1 time: 1.512002 Dec 02 15:51:21.720715 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 246/463] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:51:20 2020] POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action => generated 32 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:51:21.721365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:21.722333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:21.747855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-572159a8-c6fa-42d5-8d33-3e1f8670c11b req-dec9b199-0793-43ab-950a-7ada960cd25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a98e87c-b99a-4510-aa3d-700dab85ae10", "tag": "b6a667d0-da4b-4185-a6eb-1abe0455d2c8"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:21.749118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:21.755383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:21.756797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:21.757523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:21.766578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:51:21.766578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:51:21.795620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-572159a8-c6fa-42d5-8d33-3e1f8670c11b req-dec9b199-0793-43ab-950a-7ada960cd25f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:21.795620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-572159a8-c6fa-42d5-8d33-3e1f8670c11b req-dec9b199-0793-43ab-950a-7ada960cd25f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:21.845370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-572159a8-c6fa-42d5-8d33-3e1f8670c11b req-dec9b199-0793-43ab-950a-7ada960cd25f service nova] Creating event network-changed:b6a667d0-da4b-4185-a6eb-1abe0455d2c8 for instance 3a98e87c-b99a-4510-aa3d-700dab85ae10 on hv-cinder-73761 Dec 02 15:51:21.851001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-572159a8-c6fa-42d5-8d33-3e1f8670c11b req-dec9b199-0793-43ab-950a-7ada960cd25f service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128746 Dec 02 15:51:21.852280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 247/464] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:51:21 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:21.889514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:21.890714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:21.907410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:21.909790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:21.917240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:21.917924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:22.689470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:22.700835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b23a5ee9-8427-4684-99ad-d78f8531aaa0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1724 microversion: 2.1 time: 0.846705 Dec 02 15:51:22.701481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 248/465] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:21 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1724 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:22.712643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:22.713333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:22.723294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:22.723733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:22.724632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:22.725124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:23.035437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:23.046789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1eaaf6ed-2357-4102-ad35-b74164488091 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 0.343820 Dec 02 15:51:23.047544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 249/466] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:22 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:23.070940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:23.071668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:23.081685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:23.082201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:23.083060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:23.083566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:23.381454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:23.399755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f21f693c-f1b8-4c7d-aef5-a84dcab71564 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 0.340788 Dec 02 15:51:23.403396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 250/467] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:23 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:23.704839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:23.729346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:23.782906 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:23.783914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:23.787328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:23.788372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:24.044658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:51:24.153835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:24.277584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:24.327314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:24.334207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42259d85-f885-4b1a-ab16-d312e6c1dbad tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 2.644256 Dec 02 15:51:24.338650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 218/468] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:21 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:24.357695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2628b791-b259-4975-8e78-b8a6304059ff tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 204 len: 0 microversion: 2.1 time: 0.691256 Dec 02 15:51:24.358358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 251/469] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:51:23 2020] DELETE /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:51:24.405502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:24.406308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:24.427012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:24.438055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:24.438570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:24.444530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:24.444530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:24.454075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:24.483595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:24.486021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:24.488064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:24.488818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:25.156373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:25.193497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a762aa58-9a79-4008-a641-fb73df143b0d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 0.833315 Dec 02 15:51:25.216488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 252/470] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:24 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:25.239949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:25.240894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:25.257019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:25.276773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:25.276773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:25.276773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:25.672929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:25.700248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8f6fb129-d1db-4115-bf1e-8ae98074b554 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1516 microversion: 2.1 time: 0.481355 Dec 02 15:51:25.701468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 253/471] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:25 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1516 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:25.749445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:25.756935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:25.761252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:25.763113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:25.765242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:25.766004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:26.165439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:26.194269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2428b4c8-bcef-4ab1-9269-c14d400a1b98 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 0.476239 Dec 02 15:51:26.195426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 254/472] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:25 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:26.226805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:26.233130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:26.243421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:26.244834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:26.245931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:26.248137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:26.619612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:26.670392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:26.681908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:26.700941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d0886bc5-4447-45d6-ad55-6eece05e32b8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 0.502888 Dec 02 15:51:26.706109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 255/473] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:26 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:26.749172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:26.750483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:26.782954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:26.784847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:26.790412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:26.793942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:27.251136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:27.282113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ea40fe08-a09e-407b-9ab4-a74569a25608 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1701 microversion: 2.1 time: 2.941406 Dec 02 15:51:27.283017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 219/474] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:24 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1701 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:27.306074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:27.314722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:27.337177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:27.337964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:27.339017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:27.342941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:27.759354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:27.823461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3d3898ad-140b-4d96-9905-80e76212703b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 1.107110 Dec 02 15:51:27.825202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 256/475] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:26 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:27.909808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:27.912204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:27.963794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:27.964741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:27.982724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:27.983791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:28.755403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:28.776431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-02a05db6-b8bc-45d7-8ffb-c2fee03768fe tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1516 microversion: 2.1 time: 1.491977 Dec 02 15:51:28.777071 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 220/476] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:27 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1516 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:28.825475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-96c23845-e556-4af3-a6c4-649ddcc75a03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:28.845380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96c23845-e556-4af3-a6c4-649ddcc75a03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:28.846296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96c23845-e556-4af3-a6c4-649ddcc75a03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:28.959706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-96c23845-e556-4af3-a6c4-649ddcc75a03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Going to try to start instance {{(pid=94391) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 02 15:51:29.082139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:29.109282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b866d113-a469-4027-b3ba-2509060be317 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 1.274976 Dec 02 15:51:29.113333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 257/477] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:27 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:29.142139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:29.142812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:29.165064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:29.165647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:29.166540 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:29.167036 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:29.390871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-96c23845-e556-4af3-a6c4-649ddcc75a03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.598467 Dec 02 15:51:29.391727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 221/478] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:51:28 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:51:29.414602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:29.415385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:29.439261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:29.439775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:29.440673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:29.441221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:30.852452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:30.877333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6b0307f8-2c69-4186-b226-68c0fae95831 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 1.481091 Dec 02 15:51:30.878467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 222/479] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:29 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:30.902206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:30.906560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:30.928151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:30.928756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:30.929744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:30.931576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:31.419460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:31.447616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:31.458317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:31.460068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-75ecc797-a62a-4dca-8ad4-8ffd173f64d2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 2.343443 Dec 02 15:51:31.467755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 258/480] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:29 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:31.476782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-563c365b-106d-4e79-bc90-dd3750af6143 req-533bcde0-9377-49e6-aafd-bc2a79c486f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a98e87c-b99a-4510-aa3d-700dab85ae10", "name": "network-vif-plugged", "status": "completed", "tag": "b6a667d0-da4b-4185-a6eb-1abe0455d2c8"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:31.487501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:51:31.487501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:51:31.503512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-563c365b-106d-4e79-bc90-dd3750af6143 req-533bcde0-9377-49e6-aafd-bc2a79c486f7 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:31.504034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-563c365b-106d-4e79-bc90-dd3750af6143 req-533bcde0-9377-49e6-aafd-bc2a79c486f7 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:31.553065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-563c365b-106d-4e79-bc90-dd3750af6143 req-533bcde0-9377-49e6-aafd-bc2a79c486f7 service nova] Creating event network-vif-plugged:b6a667d0-da4b-4185-a6eb-1abe0455d2c8 for instance 3a98e87c-b99a-4510-aa3d-700dab85ae10 on hv-cinder-73761 Dec 02 15:51:31.587167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-563c365b-106d-4e79-bc90-dd3750af6143 req-533bcde0-9377-49e6-aafd-bc2a79c486f7 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124817 Dec 02 15:51:31.588213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 259/481] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:51:31 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:31.605168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:31.607721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:31.617407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:31.637594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:31.637594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:31.637594 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:31.897567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:31.922310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c306f88f-ac44-40af-ad68-2ad5d4ab4994 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1710 microversion: 2.1 time: 1.042411 Dec 02 15:51:31.927030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 223/482] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:30 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1710 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:31.958994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:31.960366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:31.982313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:31.986859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:31.998192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:32.002087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:32.294783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:32.305829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8c9e1a70-462b-481c-ba6c-832872c48636 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1306 microversion: 2.1 time: 0.715969 Dec 02 15:51:32.306922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 260/483] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:31 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1306 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:32.319498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ccc06b26-2641-40cd-ad86-e72027e4b2a9 req-3bab5c88-7243-47f7-a083-503df31b1bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05bbe402-38cd-467a-96c3-06e18c8a07a1", "name": "network-vif-deleted", "tag": "edf35ac9-cb62-4d61-b8c4-dc1b5ed92a6c"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:32.328580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:51:32.328580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:51:32.339854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ccc06b26-2641-40cd-ad86-e72027e4b2a9 req-3bab5c88-7243-47f7-a083-503df31b1bc6 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:32.341018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ccc06b26-2641-40cd-ad86-e72027e4b2a9 req-3bab5c88-7243-47f7-a083-503df31b1bc6 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:32.363521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ccc06b26-2641-40cd-ad86-e72027e4b2a9 req-3bab5c88-7243-47f7-a083-503df31b1bc6 service nova] Creating event network-vif-deleted:edf35ac9-cb62-4d61-b8c4-dc1b5ed92a6c for instance 05bbe402-38cd-467a-96c3-06e18c8a07a1 on hv-cinder-73761 Dec 02 15:51:32.369644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ccc06b26-2641-40cd-ad86-e72027e4b2a9 req-3bab5c88-7243-47f7-a083-503df31b1bc6 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061125 Dec 02 15:51:32.370384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 261/484] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:51:32 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:32.391251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:32.392064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:32.401850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:32.402353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:32.403253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:32.403840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:33.015358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:33.080891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-98510933-2f3d-4c3d-a6e4-12a387946c7f tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 0.698189 Dec 02 15:51:33.086732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 262/485] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:32 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:33.148104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:33.149442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:33.185240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:33.212984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:33.214151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:33.215113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:33.804727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:33.833111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6d8cc425-a041-48b2-845b-50fba8ec1b42 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 1.901726 Dec 02 15:51:33.833902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 224/486] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:31 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:33.838829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:33.857539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:33.858626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:33.867286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:33.868239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:33.869444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:33.870841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:33.875694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:33.896277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:33.898952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c57ea489-3c07-43e2-855c-4f0823e92f07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 0.809253 Dec 02 15:51:33.912008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 263/487] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:33 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:33.936848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:33.938960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:33.950937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:33.952094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:33.953209 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:33.953903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:34.096069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:34.100766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:34.101612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lazy-loading 'fault' on Instance uuid 05bbe402-38cd-467a-96c3-06e18c8a07a1 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:51:34.254579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:34.271724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-427b095f-a142-410b-b323-82a654a785c6 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 200 len: 1311 microversion: 2.1 time: 0.369180 Dec 02 15:51:34.281221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 264/488] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:33 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 1311 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:34.298705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:34.298705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:34.322358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:34.326826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:34.328097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:34.328815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:34.518688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:34.551203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0ddbf243-6951-48d6-ad9a-0fad0602426e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1710 microversion: 2.1 time: 0.715446 Dec 02 15:51:34.554872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 225/489] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:33 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1710 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:34.901459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:34.910325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:34.971217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:34.972396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:34.975034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:34.976020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:35.322191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:35.350815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1c949ecc-54d3-444a-99b3-d1c3a323e84b tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 1.068209 Dec 02 15:51:35.363743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 265/490] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:34 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:35.390900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:35.401104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:35.439807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:35.440312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:35.441529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:35.448824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.020330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:36.041866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e457193f-70e8-4f8e-9dc6-2bcbbe6d197f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1323 microversion: 2.1 time: 1.192655 Dec 02 15:51:36.053455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 226/491] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:34 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1323 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:36.093062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:36.094250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 05bbe402-38cd-467a-96c3-06e18c8a07a1] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:36.103127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:36.107620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.107620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:36.107620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.224377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] HTTP exception thrown: Instance 05bbe402-38cd-467a-96c3-06e18c8a07a1 could not be found. Dec 02 15:51:36.225429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Returning 404 to user: Instance 05bbe402-38cd-467a-96c3-06e18c8a07a1 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:51:36.226543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-82e63d88-5ff1-4689-9388-4ccec26d950b tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1" status: 404 len: 111 microversion: 2.1 time: 0.171744 Dec 02 15:51:36.229442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 227/492] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:36 2020] GET /compute/v2.1/servers/05bbe402-38cd-467a-96c3-06e18c8a07a1 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:51:36.278176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:36.278176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:36.296481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:36.297385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.298573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:36.300579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.346216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:36.407422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:36.424794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:36.427622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-951c93cd-0bc1-4626-8a46-6087212f4d81 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 1.061866 Dec 02 15:51:36.444743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 266/493] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:35 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:36.471935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:36.473772 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:36.489511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:36.495667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.495667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:36.495667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:36.917705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:36.944191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f4936a03-ea21-47a8-935b-c1a4bf085022 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 0.493979 Dec 02 15:51:36.952127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 267/494] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:36 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:37.067455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:37.068165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:37.093056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:37.093424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:37.094488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:37.095154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:37.638933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:37.660224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b2569f38-f5df-408e-86ff-8082fcb54967 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1513 microversion: 2.1 time: 0.602930 Dec 02 15:51:37.675288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 268/495] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:37 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1513 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:37.701608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:37.702249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:37.721133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:37.724820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:37.727205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:37.728806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:37.760201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:37.918175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-67977820-2050-48b2-8fcf-5d32a3de3674 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1714 microversion: 2.1 time: 1.686831 Dec 02 15:51:37.920969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 228/496] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:36 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1714 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:38.032612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:38.040394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:38.093751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:38.095191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:38.097114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:38.098190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:38.820853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:38.853072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:38.877950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:38.888522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c00b2714-bfe7-4331-98ea-6a777422d90a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 1.210954 Dec 02 15:51:38.908175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 269/497] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:37 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:38.985481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:38.989634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:39.032812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:39.035121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:39.036289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:39.048659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:39.401880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:51:39.432288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:39.489868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-48ee1a88-1885-4995-8257-3db9ab985bd4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 1.513076 Dec 02 15:51:39.490921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 229/498] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:37 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:40.002802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:40.028110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:40.034208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4612de44-a733-4ace-ae44-1fe16364bace tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 204 len: 0 microversion: 2.1 time: 1.113524 Dec 02 15:51:40.035512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 270/499] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:51:38 2020] DELETE /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:51:40.078362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:40.078881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:40.079735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:40.112760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:40.118168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:40.123123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:40.157364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:40.159158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:40.163278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:40.164213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:40.642756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:40.662422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:40.670720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:40.672874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d9bdfb2d-c085-4432-b93b-f04cc3bc91ae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 0.732684 Dec 02 15:51:40.674441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 230/500] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:39 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:51:40.686712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:40.687651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:40.702558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:40.703237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:40.704363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:40.704683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:41.048120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:41.073806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bca2a4b5-d285-4f79-830e-ebe514145e67 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1516 microversion: 2.1 time: 1.030096 Dec 02 15:51:41.088519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:41.122910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 271/501] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:40 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1516 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:41.166618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-33ae3482-d876-4d1b-b6dd-e5eacf19ee93 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 0.489851 Dec 02 15:51:41.174493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 231/502] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:40 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:41.716663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:41.721954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:41.747831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:41.748368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:41.749230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:41.749719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:42.135172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:42.144434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:42.180169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:42.185417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:42.187400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:42.190148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:42.426568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:42.491938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:42.523568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:42.529282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d5ed4945-03e8-4ea6-93de-606c5f38e09b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 0.822180 Dec 02 15:51:42.550279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 272/503] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:41 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:42.608468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:42.611851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:42.649688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:42.664248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:42.666220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:42.668100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:43.456888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:43.491846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bec85b37-094c-4d07-9a14-1b10ce6329a4 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1516 microversion: 2.1 time: 1.391427 Dec 02 15:51:43.505359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 232/504] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:42 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1516 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:43.591651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:43.604167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:43.614550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:43.620829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:43.622868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:43.623627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:44.882573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:44.914844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4da43ee3-faf8-4c31-85cd-a4ddfe79e173 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1572 microversion: 2.1 time: 2.362331 Dec 02 15:51:44.915486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 273/505] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:42 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1572 bytes in 2364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:44.946118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:44.946942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:44.970203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:44.970725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:44.971609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:44.972141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:45.181630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:45.226901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:45.250785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:45.252081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f445cade-19cd-418e-a722-2b960d12d4e7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1742 microversion: 2.20 time: 1.671073 Dec 02 15:51:45.252685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 233/506] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:43 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1742 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:45.396846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:45.417067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c8e4694e-b520-4232-9f13-e20a084a7f32 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1474 microversion: 2.1 time: 0.486840 Dec 02 15:51:45.423198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 274/507] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:44 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1474 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:45.611951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-fcf8b088-7b1b-4243-b626-42c1529018c5 req-07165f86-c0c4-430d-b107-1c65719e00e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7ff8d5-f591-4e0f-b4b4-162363b1135b", "name": "network-vif-deleted", "tag": "bcba1c17-23ad-42ca-a39f-5066ffafea07"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:45.623362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:51:45.623362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:51:45.640473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-fcf8b088-7b1b-4243-b626-42c1529018c5 req-07165f86-c0c4-430d-b107-1c65719e00e8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:45.640473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-fcf8b088-7b1b-4243-b626-42c1529018c5 req-07165f86-c0c4-430d-b107-1c65719e00e8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:45.660058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-fcf8b088-7b1b-4243-b626-42c1529018c5 req-07165f86-c0c4-430d-b107-1c65719e00e8 service nova] Creating event network-vif-deleted:bcba1c17-23ad-42ca-a39f-5066ffafea07 for instance fc7ff8d5-f591-4e0f-b4b4-162363b1135b on hv-cinder-73761 Dec 02 15:51:45.666485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-fcf8b088-7b1b-4243-b626-42c1529018c5 req-07165f86-c0c4-430d-b107-1c65719e00e8 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064932 Dec 02 15:51:45.673303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 234/508] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:51:45 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:51:45.941092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:45.944891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:45.962249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:45.972003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:45.973335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:45.974310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:46.293978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:46.295078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:46.316044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:46.316838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:46.323091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:46.325201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:46.520823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:46.540747 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-51c076c8-a72c-4cdc-8296-9a36d9e2e1bd tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1552 microversion: 2.1 time: 0.609703 Dec 02 15:51:46.544568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 275/509] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:45 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1552 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:46.562892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:46.567751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:46.592306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:46.593322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:46.594345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:46.595133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:46.867843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:46.914005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:46.956897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:46.966011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f1ccde8a-b78e-4956-ad00-e4c69b972557 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1724 microversion: 2.20 time: 0.691081 Dec 02 15:51:46.967422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 235/510] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:46 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1724 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:47.019549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:47.021035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:47.054338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.055690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:47.057973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.063779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:47.098427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.111629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:47.112884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lazy-loading 'fault' on Instance uuid fc7ff8d5-f591-4e0f-b4b4-162363b1135b {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:51:47.439278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:47.469366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cf0b7aea-92f9-4033-a9f6-244d9c3e418d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 200 len: 1310 microversion: 2.1 time: 0.923010 Dec 02 15:51:47.470092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 276/511] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:46 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 1310 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:47.671831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] HTTP exception thrown: Cannot 'detach_volume' instance 151ef38d-ba70-4859-93d6-24b1aad15e27 while it is in vm_state rescued Dec 02 15:51:47.671831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Returning 409 to user: Cannot 'detach_volume' instance 151ef38d-ba70-4859-93d6-24b1aad15e27 while it is in vm_state rescued {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:51:47.671831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f1ac27cb-7f60-4351-adf8-0ef5cb0b1e24 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "DELETE /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments/0fa36f27-ce90-4f85-93ad-f230d2327f45" status: 409 len: 152 microversion: 2.1 time: 0.696580 Dec 02 15:51:47.671831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 236/512] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:51:46 2020] DELETE /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments/0fa36f27-ce90-4f85-93ad-f230d2327f45 => generated 152 bytes in 698 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 02 15:51:47.684879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:47.685822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:47.695164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.695573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:47.696459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.696951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:47.948422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-944076c9-6cf4-4b32-968d-21335e01dc4d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action" status: 202 len: 0 microversion: 2.1 time: 0.271139 Dec 02 15:51:47.950346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 277/513] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:51:47 2020] POST /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:51:47.967755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:47.975448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:47.982402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.983201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:47.984319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:47.984981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.027726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:48.029364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:48.055140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:48.057070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.058283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:48.062003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.602195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:48.623077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ce40f1c0-427b-453e-9e8d-69b40c1a6dd3 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1560 microversion: 2.1 time: 0.667439 Dec 02 15:51:48.624710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 237/514] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:47 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1560 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:48.649278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:48.650590 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: fc7ff8d5-f591-4e0f-b4b4-162363b1135b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:48.669847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:48.671158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.678049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:48.679044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.692728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:48.720556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:48.756925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:48.758676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e39e1239-d587-4902-b536-60a5c8b3d4e9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1724 microversion: 2.20 time: 0.774568 Dec 02 15:51:48.759823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 278/515] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:47 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1724 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:48.812180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] HTTP exception thrown: Instance fc7ff8d5-f591-4e0f-b4b4-162363b1135b could not be found. Dec 02 15:51:48.813302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Returning 404 to user: Instance fc7ff8d5-f591-4e0f-b4b4-162363b1135b could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:51:48.814573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fac9f9b2-561a-492d-ab5c-15a1255a2664 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b" status: 404 len: 111 microversion: 2.1 time: 0.188361 Dec 02 15:51:48.815481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 238/516] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:48 2020] GET /compute/v2.1/servers/fc7ff8d5-f591-4e0f-b4b4-162363b1135b => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:51:48.831486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:48.832077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:48.841477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:48.842149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.845547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:48.846284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:48.942274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:51:49.282848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-caa2b1af-37b1-4162-bf23-9c661396c99f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 204 len: 0 microversion: 2.1 time: 0.461693 Dec 02 15:51:49.283629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 279/517] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:51:48 2020] DELETE /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:51:49.304733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:49.305524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:49.316277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:49.316793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:49.317687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:49.318191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:49.648803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:49.649585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:49.658934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:49.659521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:49.660480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:49.660981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:49.687822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:49.702369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-87e58e2a-67c7-4a73-8b7c-4e39b0547734 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1517 microversion: 2.1 time: 0.411686 Dec 02 15:51:49.703277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 239/518] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:49 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1517 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:49.785541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:49.786148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:49.795869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:49.796416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:49.797293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:49.797794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:49.967352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:49.978061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2aa64d99-e0b6-408d-97bf-9a39b23af150 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1560 microversion: 2.1 time: 0.338996 Dec 02 15:51:49.978686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 280/519] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:49 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1560 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:50.087471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:50.104617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:50.112823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:50.114869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-70cb8cad-fde8-4d3e-b5f1-32c0098fd410 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1724 microversion: 2.20 time: 0.339814 Dec 02 15:51:50.115788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 240/520] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:49 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:51:50.374400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f02752d1c80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-274750580"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:50.412338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for project e84bacbd36bc4a75898431f75ffae141. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:51:50.418899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for user d269a2a6f71e40538a8b7b7a199ec693 and project e84bacbd36bc4a75898431f75ffae141. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:51:50.434745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [b6ad5e7d-c50b-4954-94a8-18899e39a93b] AMQP server on 10.222.0.101:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 02 15:51:50.728701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:50.729385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:50.738853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:50.739360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:50.740272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:50.740793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.003102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:51.016188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f713ab48-019d-4b7e-89f6-e4b18bf428a8 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1517 microversion: 2.1 time: 0.297115 Dec 02 15:51:51.017639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 241/521] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:50 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1517 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:51.030337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:51.031189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:51.045617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.046198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.047751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.048509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.357926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:51.378204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42522755-6c8e-4c89-962d-bc348880b2a8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1560 microversion: 2.1 time: 0.358482 Dec 02 15:51:51.379062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 242/522] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:51 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1560 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:51.401039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:51.403000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:51.419155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.419691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.420575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.421064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.454073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [b6ad5e7d-c50b-4954-94a8-18899e39a93b] Reconnected to AMQP server on 10.222.0.101:5672 via [amqp] client with port 40252. Dec 02 15:51:51.668345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for project e84bacbd36bc4a75898431f75ffae141. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:51:51.674000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for user d269a2a6f71e40538a8b7b7a199ec693 and project e84bacbd36bc4a75898431f75ffae141. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:51:51.691623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ac4fc7e7-7b43-4bb1-a74b-24c25f7fa936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.628901 Dec 02 15:51:51.691943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 281/523] 10.222.0.101 () {60 vars in 1153 bytes} [Wed Dec 2 15:51:50 2020] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:51:51.731378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-77131a88-fcfa-487f-8778-223ed5c684f9 req-b95ab566-b1a7-4472-bd5e-aa8ae1201a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:51.737758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:51:51.737758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:51:51.741031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:51.750437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-77131a88-fcfa-487f-8778-223ed5c684f9 req-b95ab566-b1a7-4472-bd5e-aa8ae1201a5f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.751107 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-77131a88-fcfa-487f-8778-223ed5c684f9 req-b95ab566-b1a7-4472-bd5e-aa8ae1201a5f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.769262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:51.776493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:51.782025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a5d9b6ef-3e5d-446d-8a4a-0b16b80ec11b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1727 microversion: 2.20 time: 0.397824 Dec 02 15:51:51.782257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.compute.server_external_events [req-77131a88-fcfa-487f-8778-223ed5c684f9 req-b95ab566-b1a7-4472-bd5e-aa8ae1201a5f service nova] Unable to find a host for instance a5112b52-9227-41cf-a36c-19e97dd4222c. Dropping event network-vif-unplugged {{(pid=94390) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Dec 02 15:51:51.782346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 243/524] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:51 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1727 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:51.782421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-77131a88-fcfa-487f-8778-223ed5c684f9 req-b95ab566-b1a7-4472-bd5e-aa8ae1201a5f service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.083894 Dec 02 15:51:51.782421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 282/525] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:51:51 2020] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 02 15:51:51.789955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-518477fc-c85c-4dcb-9537-1437f459b111 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f0263b09048>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-2048584045", "description": "tempest-TestVolumeBootPattern-2048584045 description"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:51.803825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b18a11d5-0fef-4d97-beca-92b865922fc2"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:51.805112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:51.819303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.819303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:51.819623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:51.820061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:52.456559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-518477fc-c85c-4dcb-9537-1437f459b111 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.674677 Dec 02 15:51:52.458107 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 244/526] 10.222.0.101 () {60 vars in 1175 bytes} [Wed Dec 2 15:51:51 2020] POST /compute/v2.1/os-security-groups => generated 251 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:52.476183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:52.477432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:52.517492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:52.518653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:52.520461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:52.521470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:52.921105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4426f427-b15c-4dc5-8563-1b6b67707e96 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.126951 Dec 02 15:51:52.922882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 283/527] 10.222.0.101 () {62 vars in 1359 bytes} [Wed Dec 2 15:51:51 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-volume_attachments => generated 188 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:51:52.939081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:52.940011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:52.952395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:52.953111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:52.954570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:52.955705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:53.490827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:53.506459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9e39341b-bd1a-4df8-9083-f080419d2d87 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1566 microversion: 2.1 time: 0.581973 Dec 02 15:51:53.507704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 284/528] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:52 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1566 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:53.520729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-37160277-0354-477d-a81b-024b47c9509d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f027064d2f0>, body: {"security_group_rule": {"parent_group_id": "84b94ee0-92cf-4dbe-8dc6-c45763dad97a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:53.588749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:53.608105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-acd5290a-bd41-4e69-8311-495e6ab56e21 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1517 microversion: 2.1 time: 1.146685 Dec 02 15:51:53.609762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 245/529] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:52 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1517 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:53.623895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:53.625725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:53.641475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:53.643104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:53.644297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:53.645030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:53.939443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-837293a1-dbb4-4fb6-a41c-99065b35aa4a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action" status: 202 len: 0 microversion: 2.20 time: 0.328171 Dec 02 15:51:53.945516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 246/530] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:51:53 2020] POST /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:51:53.968965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:53.969850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:53.993160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:53.994329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:53.999206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:54.000023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:54.114577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-37160277-0354-477d-a81b-024b47c9509d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.605249 Dec 02 15:51:54.115713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 285/531] 10.222.0.101 () {60 vars in 1190 bytes} [Wed Dec 2 15:51:53 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:54.136066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:54.140250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:54.161497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:54.166034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:54.168039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:54.169661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:54.476385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:54.493951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:54.502609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f58500af-dd0a-4fc6-8f48-3d990d834595 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "DELETE /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments/0fa36f27-ce90-4f85-93ad-f230d2327f45" status: 202 len: 0 microversion: 2.1 time: 0.559900 Dec 02 15:51:54.503301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 247/532] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:51:53 2020] DELETE /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27/os-volume_attachments/0fa36f27-ce90-4f85-93ad-f230d2327f45 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:51:54.508260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:54.520441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-629586dc-867a-4dde-b947-db2f5f2fa285 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1753 microversion: 2.20 time: 0.402862 Dec 02 15:51:54.522246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 286/533] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:54 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1753 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:54.526402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-31fb88a9-26ad-41bf-b7f2-b72817cec3ec tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f0263cdc488>, body: {"security_group_rule": {"parent_group_id": "84b94ee0-92cf-4dbe-8dc6-c45763dad97a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:54.538016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-75701fdf-a4c3-451e-8097-c5c8532073c6 req-0a6f4544-34fa-41a7-97ce-c069044a5e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bc7128f-2441-4c19-8fab-86f5b2239e56", "name": "network-vif-deleted", "tag": "0fc63adc-a95c-4e8b-bc36-37690089fe6e"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:51:54.546605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:51:54.546605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:51:54.560570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-75701fdf-a4c3-451e-8097-c5c8532073c6 req-0a6f4544-34fa-41a7-97ce-c069044a5e1b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:54.562102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-75701fdf-a4c3-451e-8097-c5c8532073c6 req-0a6f4544-34fa-41a7-97ce-c069044a5e1b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:54.607300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-75701fdf-a4c3-451e-8097-c5c8532073c6 req-0a6f4544-34fa-41a7-97ce-c069044a5e1b service nova] Creating event network-vif-deleted:0fc63adc-a95c-4e8b-bc36-37690089fe6e for instance 2bc7128f-2441-4c19-8fab-86f5b2239e56 on hv-cinder-73761 Dec 02 15:51:54.618554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-75701fdf-a4c3-451e-8097-c5c8532073c6 req-0a6f4544-34fa-41a7-97ce-c069044a5e1b service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094568 Dec 02 15:51:54.622260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 287/534] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:51:54 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:54.658296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:54.669115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:54.678789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:54.679556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:54.680789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:54.681544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:54.896252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:54.922441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e5323d5f-62ab-44aa-b410-99b36d2ce85d tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 200 len: 1306 microversion: 2.1 time: 0.289918 Dec 02 15:51:54.923098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 288/535] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:54 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 1306 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:55.179436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-31fb88a9-26ad-41bf-b7f2-b72817cec3ec tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.674605 Dec 02 15:51:55.181254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 248/536] 10.222.0.101 () {60 vars in 1190 bytes} [Wed Dec 2 15:51:54 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:51:55.567282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:55.568131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:55.577634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:55.578144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:55.579015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:55.579516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:55.952284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:55.963679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:55.966229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: 2bc7128f-2441-4c19-8fab-86f5b2239e56] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:55.986975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:55.997316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:55.997603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:55.998251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:55.999222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1c0ccab4-9d1a-4b83-b1a4-50576032064f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1753 microversion: 2.20 time: 0.443221 Dec 02 15:51:55.999871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:56.000494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 289/537] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:55 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1753 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:56.000870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:56.123285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] HTTP exception thrown: Instance 2bc7128f-2441-4c19-8fab-86f5b2239e56 could not be found. Dec 02 15:51:56.124345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Returning 404 to user: Instance 2bc7128f-2441-4c19-8fab-86f5b2239e56 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:51:56.125457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-daf2f431-5f4b-4b3a-bad0-a002fe3e65ba tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56" status: 404 len: 111 microversion: 2.1 time: 0.188092 Dec 02 15:51:56.126479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 249/538] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:55 2020] GET /compute/v2.1/servers/2bc7128f-2441-4c19-8fab-86f5b2239e56 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:51:57.046241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:57.048105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:57.060642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:57.062255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:57.063315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:57.064042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:57.425915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:57.458990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:57.477246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:57.481782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-265361a3-4563-41bd-9a3c-116f96917d22 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1753 microversion: 2.20 time: 0.451544 Dec 02 15:51:57.483231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 290/539] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:57 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1753 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:57.665343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:57.666017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:57.675133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:57.676036 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:57.677218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:57.677958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:57.763277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:51:58.157937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-438e9aac-5f45-4abe-84d2-9815c935cd3f tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "DELETE /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 204 len: 0 microversion: 2.1 time: 0.504543 Dec 02 15:51:58.159785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 250/540] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:51:57 2020] DELETE /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:51:58.177469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:58.178250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:58.187192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:58.187776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:58.188794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:58.189369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:58.452664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:58.462245 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bccb0000-d42a-4ae3-a472-befe20820a83 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1516 microversion: 2.1 time: 0.295931 Dec 02 15:51:58.462884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 291/541] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:58 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:58.509836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:58.510642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:58.519747 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:58.520483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:58.521309 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:58.521810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:58.797015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:58.815800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:58.832464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:58.834872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d3dc7397-53af-4b9f-bb26-ce352446c44a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1753 microversion: 2.20 time: 0.335449 Dec 02 15:51:58.836034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 251/542] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:58 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1753 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:51:59.488116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:59.488810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:59.497950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:59.498512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:59.499422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:59.499957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:59.773620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:51:59.787434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c24ed00f-01ff-4f38-833b-945a95d8fe77 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1516 microversion: 2.1 time: 0.309235 Dec 02 15:51:59.790111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 292/543] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:51:59 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:51:59.887643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:51:59.888945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:51:59.905208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:59.906134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:51:59.907655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:51:59.908579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.150649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:00.152634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:00.168372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:00.169290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.170872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:00.171515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.294065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:00.294554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:52:00.324711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:00.340733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:00.343604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3202b2ea-ef4a-40c1-9604-0807cdfc4b56 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1753 microversion: 2.20 time: 0.475001 Dec 02 15:52:00.356238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 252/544] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:51:59 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1753 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:00.563289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6a44431a-1677-4a5f-b591-5427bc3fd3be tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "DELETE /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 204 len: 0 microversion: 2.1 time: 0.430780 Dec 02 15:52:00.564804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 293/545] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:52:00 2020] DELETE /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:52:00.587115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:00.588314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:00.597538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:00.598043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.598909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:00.599404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.820756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:00.821908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:00.832940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:00.833754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.835036 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:00.835794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:00.951301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:00.967016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8fb21fc8-6a3e-4b27-bd11-ebab2dd00b6e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1512 microversion: 2.1 time: 0.398003 Dec 02 15:52:00.967952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 253/546] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:00 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:01.227872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-320d7dc1-fd95-4a48-b728-70b94b458364 req-e0b4600b-0765-4028-b764-e4aebbf5a92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86e0adf-e547-4dc7-a347-22a102b5928e", "name": "network-vif-unplugged", "status": "completed", "tag": "18ae3e68-f199-402b-ad16-0125e857e166"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:01.236482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:01.254038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:01.254038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:01.268583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-590071b4-79f6-4d3c-b044-a11469b6aa40 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1516 microversion: 2.1 time: 0.463204 Dec 02 15:52:01.269875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 294/547] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:00 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1516 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:01.310952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-320d7dc1-fd95-4a48-b728-70b94b458364 req-e0b4600b-0765-4028-b764-e4aebbf5a92f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:01.311905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-320d7dc1-fd95-4a48-b728-70b94b458364 req-e0b4600b-0765-4028-b764-e4aebbf5a92f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:01.374331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-320d7dc1-fd95-4a48-b728-70b94b458364 req-e0b4600b-0765-4028-b764-e4aebbf5a92f service nova] Creating event network-vif-unplugged:18ae3e68-f199-402b-ad16-0125e857e166 for instance e86e0adf-e547-4dc7-a347-22a102b5928e on hv-cinder-73761 Dec 02 15:52:01.391497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-320d7dc1-fd95-4a48-b728-70b94b458364 req-e0b4600b-0765-4028-b764-e4aebbf5a92f service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.186921 Dec 02 15:52:01.393128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 254/548] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:01 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:01.400516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:01.400893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:01.412125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:01.412125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:01.416385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:01.416385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:01.706806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:01.727207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:01.736037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:01.737474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4dc40535-9d53-40a9-b5a7-08f32fb55165 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1753 microversion: 2.20 time: 0.363631 Dec 02 15:52:01.752051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 295/549] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:01 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1753 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:01.994355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:01.995771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:02.007234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.007722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.008843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.009632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.307049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:02.307929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:02.342372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.343565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.345327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.346280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.484905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 15:52:02.485187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 15:52:02 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b (ip 10.222.0.101) !!! Dec 02 15:52:02.711431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:02.743780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:02.750150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fb6fb9aa-c7e6-47e3-96b0-f0a16b16a696 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1474 microversion: 2.1 time: 0.452470 Dec 02 15:52:02.764363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 296/550] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:02 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1474 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:02.794802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bc69cf94-dbeb-451a-aa36-fd1dce8f9deb tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1512 microversion: 2.1 time: 0.810843 Dec 02 15:52:02.796541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 255/551] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:01 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1512 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:02.806937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-52941d19-9df1-40f6-a1fa-788d9269576b req-3ea0c01f-4b0b-4c4d-a74a-9a248ed73b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86e0adf-e547-4dc7-a347-22a102b5928e", "name": "network-vif-deleted", "tag": "18ae3e68-f199-402b-ad16-0125e857e166"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:02.818122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:02.819237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:02.821161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:02.821161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:02.831052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-52941d19-9df1-40f6-a1fa-788d9269576b req-3ea0c01f-4b0b-4c4d-a74a-9a248ed73b6e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.831553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-52941d19-9df1-40f6-a1fa-788d9269576b req-3ea0c01f-4b0b-4c4d-a74a-9a248ed73b6e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.835184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.835968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.837698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:02.839295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:02.864205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-52941d19-9df1-40f6-a1fa-788d9269576b req-3ea0c01f-4b0b-4c4d-a74a-9a248ed73b6e service nova] Creating event network-vif-deleted:18ae3e68-f199-402b-ad16-0125e857e166 for instance e86e0adf-e547-4dc7-a347-22a102b5928e on hv-cinder-73761 Dec 02 15:52:02.882599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-52941d19-9df1-40f6-a1fa-788d9269576b req-3ea0c01f-4b0b-4c4d-a74a-9a248ed73b6e service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130434 Dec 02 15:52:02.883733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 297/552] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:02 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:03.232620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:03.249613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:03.256986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:03.258350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d5ca127f-e1b7-4da1-bce8-425871487335 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1755 microversion: 2.20 time: 0.460101 Dec 02 15:52:03.258915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 256/553] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:02 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1755 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:03.805664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:03.806981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:03.823826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:03.825044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:03.827073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:03.828228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:03.846254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:03.847767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:03.864565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:03.865748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:03.867633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:03.868722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:04.000960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:04.002080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:04.002811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lazy-loading 'fault' on Instance uuid e86e0adf-e547-4dc7-a347-22a102b5928e {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:52:04.130065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792f7ff55fec492a8cf35f9e27c85210', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf0ccd282f4042c2af3ebf05183275c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:04.150566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e62185fd-da46-4d05-870b-7665740aeb59 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 200 len: 1311 microversion: 2.1 time: 0.376006 Dec 02 15:52:04.176795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 298/554] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:03 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 1311 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:04.287648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:04.288016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:04.288611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:04.298298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af60dbad-7d16-4390-9832-2be434a8cd01 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1512 microversion: 2.1 time: 0.482452 Dec 02 15:52:04.298604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:04.299078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 257/555] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:03 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:04.299233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:04.300352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:04.300910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:04.553728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:04.571560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:04.579803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:04.581186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4864ffc4-f272-4c89-acc3-93afbc2789f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1755 microversion: 2.20 time: 0.305296 Dec 02 15:52:04.581933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 299/556] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:04 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1755 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:52:05.208636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:05.210275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] [instance: e86e0adf-e547-4dc7-a347-22a102b5928e] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:05.230495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.231383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:05.232534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.233346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:05.324666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-190b0e79-8831-4ca1-b6fd-6e6a8aa77bb4 req-11b3a207-302d-4d99-bac2-0efa7b23dd7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b68ba3-ad18-47ee-80c0-8282bdd3368b", "name": "network-vif-unplugged", "status": "completed", "tag": "befb71b0-ee0d-4d99-a7e5-e25e48227efc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:05.344652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:05.344652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:05.371898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] HTTP exception thrown: Instance e86e0adf-e547-4dc7-a347-22a102b5928e could not be found. Dec 02 15:52:05.373048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] Returning 404 to user: Instance e86e0adf-e547-4dc7-a347-22a102b5928e could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:52:05.378459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b6d04d6c-3c04-439d-b0dd-104151cc3922 tempest-AttachVolumeNegativeTest-2008961866 tempest-AttachVolumeNegativeTest-2008961866] 10.222.0.101 "GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e" status: 404 len: 111 microversion: 2.1 time: 0.187007 Dec 02 15:52:05.381725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 258/557] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:05 2020] GET /compute/v2.1/servers/e86e0adf-e547-4dc7-a347-22a102b5928e => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 02 15:52:05.384109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-190b0e79-8831-4ca1-b6fd-6e6a8aa77bb4 req-11b3a207-302d-4d99-bac2-0efa7b23dd7a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.385244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-190b0e79-8831-4ca1-b6fd-6e6a8aa77bb4 req-11b3a207-302d-4d99-bac2-0efa7b23dd7a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:05.414166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:05.414940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:05.455259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-190b0e79-8831-4ca1-b6fd-6e6a8aa77bb4 req-11b3a207-302d-4d99-bac2-0efa7b23dd7a service nova] Creating event network-vif-unplugged:befb71b0-ee0d-4d99-a7e5-e25e48227efc for instance 62b68ba3-ad18-47ee-80c0-8282bdd3368b on hv-cinder-73761 Dec 02 15:52:05.462968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.463486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:05.470704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.471228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:05.477948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-190b0e79-8831-4ca1-b6fd-6e6a8aa77bb4 req-11b3a207-302d-4d99-bac2-0efa7b23dd7a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193687 Dec 02 15:52:05.478617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 300/558] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:05 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:05.614971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:05.615775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:05.632364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.633688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:05.636197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:05.637409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:06.090625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:06.110695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ffb00e50-62e3-4007-851d-1379d3f520f0 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1512 microversion: 2.1 time: 0.726600 Dec 02 15:52:06.112307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 259/559] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:05 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1512 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:06.332854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:06.354052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:06.361486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:06.362743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8beaff8b-e914-47e3-84ae-f34ed27caed6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1755 microversion: 2.20 time: 0.763129 Dec 02 15:52:06.363389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 301/560] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:05 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1755 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:07.152606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:07.154704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:07.175063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:07.177045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:07.179297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:07.181052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:07.422252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:07.425407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:07.446279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:07.447793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:07.450905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:07.452789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:08.122493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:08.145491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ad9d9122-32a9-4078-8f29-698723ea3518 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1512 microversion: 2.1 time: 1.017709 Dec 02 15:52:08.147528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 260/561] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:07 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1512 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:08.324295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf58f292-6779-463e-91ae-7e123365f0c9", "device": "/dev/sdb"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:08.327720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:08.344458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:08.345348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:08.346943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:08.347850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:08.757381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:08.801057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:08.819889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:08.825180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2809c721-4fc3-406d-b430-c5baa56c0198 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1755 microversion: 2.20 time: 1.443228 Dec 02 15:52:08.826779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 302/562] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:07 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1755 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:08.849355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-d1c5a659-b521-4e95-8adf-891a753c3362 req-ebea1aba-3f99-4ec8-b16f-c3aefd0c03eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b68ba3-ad18-47ee-80c0-8282bdd3368b", "name": "network-vif-deleted", "tag": "befb71b0-ee0d-4d99-a7e5-e25e48227efc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:08.857972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:08.857972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:08.868384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-d1c5a659-b521-4e95-8adf-891a753c3362 req-ebea1aba-3f99-4ec8-b16f-c3aefd0c03eb service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:08.868939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-d1c5a659-b521-4e95-8adf-891a753c3362 req-ebea1aba-3f99-4ec8-b16f-c3aefd0c03eb service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:08.911517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-d1c5a659-b521-4e95-8adf-891a753c3362 req-ebea1aba-3f99-4ec8-b16f-c3aefd0c03eb service nova] Creating event network-vif-deleted:befb71b0-ee0d-4d99-a7e5-e25e48227efc for instance 62b68ba3-ad18-47ee-80c0-8282bdd3368b on hv-cinder-73761 Dec 02 15:52:08.916230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-d1c5a659-b521-4e95-8adf-891a753c3362 req-ebea1aba-3f99-4ec8-b16f-c3aefd0c03eb service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086480 Dec 02 15:52:08.917154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 303/563] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:08 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:09.185665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:09.186433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:09.196185 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:09.196692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:09.197556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:09.198591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:09.332901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:09.333998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:09.334984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lazy-loading 'fault' on Instance uuid 62b68ba3-ad18-47ee-80c0-8282bdd3368b {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:52:09.473032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3ad8152a-49b0-411a-96c0-3c71344a26f4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "POST /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.170030 Dec 02 15:52:09.474269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 261/564] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:52:08 2020] POST /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:09.607862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:09.630577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-df0a279f-694a-46b9-94ce-f5da79c41678 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 200 len: 1316 microversion: 2.1 time: 0.455980 Dec 02 15:52:09.645152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 304/565] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:09 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:09.867413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:09.870018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:09.886981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:09.888179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:09.889864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:09.891090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:10.363556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:10.402204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:10.418307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:10.420823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1179d24e-f79a-42bb-8056-bc3e6b72634c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.575778 Dec 02 15:52:10.422380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 262/566] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:09 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:10.671272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:10.672641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 62b68ba3-ad18-47ee-80c0-8282bdd3368b] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:10.689055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:10.690960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:10.693545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:10.694736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:10.883895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] HTTP exception thrown: Instance 62b68ba3-ad18-47ee-80c0-8282bdd3368b could not be found. Dec 02 15:52:10.884663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Returning 404 to user: Instance 62b68ba3-ad18-47ee-80c0-8282bdd3368b could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:52:10.888611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2b37ef81-5fa2-457a-97b5-3d77bac77263 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b" status: 404 len: 111 microversion: 2.1 time: 0.228779 Dec 02 15:52:10.889933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 305/567] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:10 2020] GET /compute/v2.1/servers/62b68ba3-ad18-47ee-80c0-8282bdd3368b => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:52:10.914585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:10.915570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:10.931672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:10.932910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:10.934665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:10.935914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:11.105753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:52:11.452786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:11.453501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:11.462544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:11.463347 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:11.464800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:11.465603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:11.471454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1f54843c-1d62-4da7-af93-e8ba9443b42e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "DELETE /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 204 len: 0 microversion: 2.1 time: 0.574999 Dec 02 15:52:11.473060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 263/568] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:52:10 2020] DELETE /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:52:11.506156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:11.509290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:11.530368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:11.531447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:11.533064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:11.534009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:11.815169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:11.833028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:11.842237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:11.844060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7f9a8bc9-84a8-407b-82bd-b01b6e021101 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.405055 Dec 02 15:52:11.844860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 306/569] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:11 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:11.902059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:11.921454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a1646357-ef96-4291-bda6-986956891d19 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.442769 Dec 02 15:52:11.922609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 264/570] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:11 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:12.892946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:12.894144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:12.909723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:12.910457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:12.912190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:12.912905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:12.950104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:12.951084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:12.966972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:12.967480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:12.968822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:12.969298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:13.340382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:13.351321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bd52a4c5-0bbb-4863-8538-2d36d0e828b2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.412360 Dec 02 15:52:13.351953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 265/571] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:12 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:13.355026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:13.391149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:13.408265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:13.410843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-05cfc567-f613-484f-af78-a1f661d85696 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.537303 Dec 02 15:52:13.412633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 307/572] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:12 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:14.376988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:14.378055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:14.388279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:14.388946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:14.389912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:14.390525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:14.458134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:14.459843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:14.478799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:14.480998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:14.483385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:14.484698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:14.899168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:14.917565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-32059c5d-5e25-4ed3-96cf-df4e823a3a9c tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.549771 Dec 02 15:52:14.918825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 266/573] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:14 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:14.959249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:14.978163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:14.989260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:14.990715 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ce07b452-3b3d-44fb-bea7-1833aa390f0a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.555789 Dec 02 15:52:14.991717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f64065aa-556d-4338-9b8b-fee81dffe3d0 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f0263cdcb70>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:14.991889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 308/574] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:14 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:52:15.118249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f64065aa-556d-4338-9b8b-fee81dffe3d0 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/60e9b2ba-04e2-4420-b890-b88b9373258f" status: 200 len: 351 microversion: 2.1 time: 0.135109 Dec 02 15:52:15.124246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 267/575] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:52:14 2020] GET /compute/v2.1/os-volumes/60e9b2ba-04e2-4420-b890-b88b9373258f => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:15.969141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:15.971098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:16.003510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:16.045139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:16.047229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:16.048476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:16.079440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:16.101246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:16.169092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:16.173456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:16.175342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:16.181408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:16.835024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:16.855205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:16.871796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:16.875126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fd337b09-c5ff-406c-af10-ac4a8f21e501 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.851075 Dec 02 15:52:16.877408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 268/576] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:16 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:16.975945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:16.999388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2a614fdf-7256-4a60-b1fa-cbbf1e26e120 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 1.053333 Dec 02 15:52:16.999388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 309/577] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:15 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:17.607289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ce3051d7-10ff-4f4e-a97b-f4b346281733 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f0263cdc158>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:17.784119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ce3051d7-10ff-4f4e-a97b-f4b346281733 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/3d06d2fc-4167-42fe-aff0-b6c814597370" status: 200 len: 351 microversion: 2.1 time: 0.186113 Dec 02 15:52:17.785199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 269/578] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:52:17 2020] GET /compute/v2.1/os-volumes/3d06d2fc-4167-42fe-aff0-b6c814597370 => generated 351 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:17.933571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:17.935408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:17.952470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:17.953142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:17.954159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:17.954768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:18.070534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:18.074444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:18.110262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:18.117801 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:18.120288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:18.121402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:18.393862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:18.427531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:18.436376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:18.437938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4c3122c9-a71a-4137-9a08-39cddc0258cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.529157 Dec 02 15:52:18.439203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 310/579] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:17 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:18.615796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:18.615796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-27dcf1c0-0a60-43ed-86d5-8340e7067ae9 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.535802 Dec 02 15:52:18.615796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 270/580] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:18 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:19.473311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:19.474816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:19.491768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:19.491929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:19.493765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:19.495193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:19.610820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:19.612485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:19.628235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:19.629099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:19.630649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:19.631571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:19.933194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:19.951192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:19.958838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:19.960595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-77fa5fdf-3989-48e5-a3e0-55e9f05b24be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.505615 Dec 02 15:52:19.961476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 311/581] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:19 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:20.046061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:20.071766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dacb07d4-7c42-4c51-ba4d-77b194404fa8 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.484103 Dec 02 15:52:20.073210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 271/582] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:19 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:20.361758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9eb5bddb-bd43-4a3c-8839-3c8a128fba27 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f02705fcea0>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:20.486360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9eb5bddb-bd43-4a3c-8839-3c8a128fba27 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/d38dd7c2-f393-46ae-abc2-373eaa1633c3" status: 200 len: 350 microversion: 2.1 time: 0.135516 Dec 02 15:52:20.487081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 312/583] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:52:20 2020] GET /compute/v2.1/os-volumes/d38dd7c2-f393-46ae-abc2-373eaa1633c3 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:20.505794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-228d5260-6ff9-463c-979a-662e66e71ba1 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f0263cdc378>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:20.610962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-228d5260-6ff9-463c-979a-662e66e71ba1 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.114452 Dec 02 15:52:20.611593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 272/584] 10.222.0.101 () {58 vars in 1129 bytes} [Wed Dec 2 15:52:20 2020] GET /compute/v2.1/os-volumes => generated 1035 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:20.631021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-46f789c6-6406-4120-867f-65bcc773db6b tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f027064d510>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:20.739080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-46f789c6-6406-4120-867f-65bcc773db6b tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.118234 Dec 02 15:52:20.740351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 313/585] 10.222.0.101 () {58 vars in 1144 bytes} [Wed Dec 2 15:52:20 2020] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:20.765404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-64d13c9a-df14-4819-9bde-127cad81e437 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f0263cdc158>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:20.909841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-64d13c9a-df14-4819-9bde-127cad81e437 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.154801 Dec 02 15:52:20.912824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 273/586] 10.222.0.101 () {58 vars in 1129 bytes} [Wed Dec 2 15:52:20 2020] GET /compute/v2.1/os-volumes => generated 1035 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:20.937776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0acd9ace-5e88-4199-bb5a-0f05c9bc7bc9 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f02705fc1e0>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:20.997851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:20.998538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:21.018154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:21.018693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:21.019566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:21.026641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:21.065580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0acd9ace-5e88-4199-bb5a-0f05c9bc7bc9 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.144743 Dec 02 15:52:21.066472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 314/587] 10.222.0.101 () {58 vars in 1162 bytes} [Wed Dec 2 15:52:20 2020] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:21.085573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7b4829e2-b1e4-43bc-9c81-d375f9d2b412 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f02710247b8>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:21.272958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7b4829e2-b1e4-43bc-9c81-d375f9d2b412 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.197137 Dec 02 15:52:21.273903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 315/588] 10.222.0.101 () {58 vars in 1165 bytes} [Wed Dec 2 15:52:21 2020] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:21.306282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:21.307494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:21.326098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:21.327024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:21.328203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:21.328946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:21.536672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:21.607714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:21.615763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:21.617495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e0c5982b-c863-44b0-bb0a-8c52c7bde7c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.630069 Dec 02 15:52:21.618331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 274/589] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:20 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:52:21.629707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-27d6ce0a-eb2d-44d0-9dc7-987583fdfd9f tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f0263eea1e0>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:21.689020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:21.719240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e56f0d22-6ba2-4e5d-8d5c-d5c3da26ae63 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.422763 Dec 02 15:52:21.720010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 316/590] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:21 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:21.802310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-27d6ce0a-eb2d-44d0-9dc7-987583fdfd9f tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.182136 Dec 02 15:52:21.803562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 275/591] 10.222.0.101 () {58 vars in 1150 bytes} [Wed Dec 2 15:52:21 2020] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:21.824097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ea2522f1-5392-4ef0-b838-e9f9320be93c tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f02705fce18>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:21.987165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ea2522f1-5392-4ef0-b838-e9f9320be93c tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.173244 Dec 02 15:52:21.987848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 317/592] 10.222.0.101 () {58 vars in 1183 bytes} [Wed Dec 2 15:52:21 2020] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:52:22.015633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-114459dd-0739-44e8-9dc3-fa9d479434e7 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] Calling method '.version_select at 0x7f0263cdcae8>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:22.163262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-114459dd-0739-44e8-9dc3-fa9d479434e7 tempest-VolumesTestJSON-266798023 tempest-VolumesTestJSON-266798023] 10.222.0.101 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.164327 Dec 02 15:52:22.164910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 276/593] 10.222.0.101 () {58 vars in 1150 bytes} [Wed Dec 2 15:52:21 2020] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:22.656456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:22.657807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:22.673929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:22.675493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:22.677158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:22.678069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:22.758352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:22.759024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:22.790119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:22.790662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:22.792062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:22.792560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:23.011799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:23.030630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:23.045239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:23.046731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6a821135-d758-4232-b799-90243e3164b4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.399995 Dec 02 15:52:23.047400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 318/594] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:22 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:23.125225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:23.136507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a1a6476d-8ffd-409c-8c1f-79b34df35529 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.388922 Dec 02 15:52:23.137525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 277/595] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:22 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:24.074326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:24.075009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:24.101270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:24.101773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:24.102970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:24.103547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:24.173045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:24.174082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:24.183722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:24.184619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:24.185706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:24.186395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:24.470983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:24.483542 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:24.495533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-18a02101-68b3-49a4-acc4-fda8d0ccbfb1 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.332723 Dec 02 15:52:24.496369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 278/596] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:24 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:24.513043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:24.520466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:24.521649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-32403e00-7fc1-49ce-a630-b4c908d3653c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.458836 Dec 02 15:52:24.522260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 319/597] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:24 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:25.530816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:25.532493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:25.554588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:25.555463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:25.558535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:25.559557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:25.567202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:25.568883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:25.585558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:25.586560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:25.588692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:25.589962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:25.857121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:25.868124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-929e1c4c-f7ce-4a5a-a04d-6510625fc483 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.357429 Dec 02 15:52:25.868850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 279/598] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:25 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:26.183782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:26.200029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:26.207191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:26.208520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1e25cd80-5774-40b2-b1ac-26b550f35042 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.669605 Dec 02 15:52:26.209147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 320/599] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:25 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:26.904600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:26.905365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:26.914498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:26.915001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:26.917645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:26.917645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:27.236931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:27.242405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:27.255518 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:27.268310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:27.269912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:27.273139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:27.274180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:27.275132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-743b51a3-2e14-4d67-8f59-761abc49721d tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.382220 Dec 02 15:52:27.276900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 280/600] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:26 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:27.686502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:27.705431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:27.717312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:27.718833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7944d97a-b21b-44d5-8c52-a42eef1af60b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.492633 Dec 02 15:52:27.719541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 321/601] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:27 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:52:28.309629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:28.310353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:28.318607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:28.319132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:28.320183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:28.320560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:28.583004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:28.594606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3f04f682-33b1-4d43-9687-7dbb9479d10e tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.295440 Dec 02 15:52:28.595220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 281/602] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:28 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:28.756236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:28.757646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:28.772629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:28.773677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:28.775392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:28.776996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:29.257896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:29.276305 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:29.284464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:29.286491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-372361bf-7682-4301-b712-bf42ffc9b055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.548345 Dec 02 15:52:29.287319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 322/603] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:28 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:29.645369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:29.647726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:29.663468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:29.664674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:29.666173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:29.667205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:30.057486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:30.079418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d5803136-a195-4527-805a-b0d83c551073 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.466144 Dec 02 15:52:30.092112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 282/604] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:29 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:30.341012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:30.342288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:30.359574 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:30.360504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:30.362054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:30.362935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:30.738800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:30.761132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:30.772266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:30.774630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-94f01bbe-761a-46c1-af3b-a3cc8a6c6f1a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.457495 Dec 02 15:52:30.775334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 323/605] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:30 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:31.138060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:31.138740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:31.159419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:31.160313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:31.161214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:31.161713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:31.471683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:31.481913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-38206335-0740-484d-a79b-0c6060e5d7c6 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.372713 Dec 02 15:52:31.482533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 283/606] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:31 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:31.803381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:31.804324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:31.813683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:31.814200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:31.815138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:31.815649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:32.122989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:32.142689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:32.150384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:32.151787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-aac57a5e-3bca-46f9-aa9a-874b7011874b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.358143 Dec 02 15:52:32.152675 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 324/607] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:31 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:32.507405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:32.508308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:32.517376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:32.518161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:32.519123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:32.519712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:32.805483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:32.816382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-873f8574-4603-4fab-a4ee-b7479e3438ad tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.318781 Dec 02 15:52:32.817161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 284/608] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:32 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:33.200049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:33.203148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:33.225385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:33.226296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:33.236485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:33.237410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:33.741437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:33.816913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:33.836640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:33.841356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fdb222d9-d376-4093-b39c-982696cf792b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.672024 Dec 02 15:52:33.843661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 325/609] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:33 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:33.855399 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:33.856114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:33.870739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:33.871644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:33.872776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:33.873457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:34.252267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:34.263069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-44405380-20cf-4ce5-8d45-b28c3b87a6f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1526 microversion: 2.1 time: 0.419950 Dec 02 15:52:34.263927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 285/610] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:33 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1526 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:34.891206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:34.892703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:34.911167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:34.912139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:34.913774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:34.914692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:35.279472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-b3aabb10-3780-4477-ad0b-fcd15947c63f req-5dd4a0a4-c762-4e79-9dda-54da0f3a6d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "151ef38d-ba70-4859-93d6-24b1aad15e27", "name": "network-vif-deleted", "tag": "033ff3dd-4a44-4c88-8208-f4ce9a19a0e6"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:35.316474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:35.316474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:35.335371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b3aabb10-3780-4477-ad0b-fcd15947c63f req-5dd4a0a4-c762-4e79-9dda-54da0f3a6d99 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:35.336331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b3aabb10-3780-4477-ad0b-fcd15947c63f req-5dd4a0a4-c762-4e79-9dda-54da0f3a6d99 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:35.377505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-b3aabb10-3780-4477-ad0b-fcd15947c63f req-5dd4a0a4-c762-4e79-9dda-54da0f3a6d99 service nova] Creating event network-vif-deleted:033ff3dd-4a44-4c88-8208-f4ce9a19a0e6 for instance 151ef38d-ba70-4859-93d6-24b1aad15e27 on hv-cinder-73761 Dec 02 15:52:35.386897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-b3aabb10-3780-4477-ad0b-fcd15947c63f req-5dd4a0a4-c762-4e79-9dda-54da0f3a6d99 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127913 Dec 02 15:52:35.388135 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 286/611] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:35 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:35.397465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:35.412166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:35.413570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:35.417188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:35.424201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:35.425465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5086ced3-b302-453e-ab3d-c2298a182c27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.553625 Dec 02 15:52:35.426044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 326/612] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:34 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:35.433487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:35.433487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:35.434032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:35.434988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:35.643831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:35.654187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-515eec97-78cd-4561-bbc8-457da8b27375 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1484 microversion: 2.1 time: 0.264118 Dec 02 15:52:35.654792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 287/613] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:35 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1484 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:36.452402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:36.453199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:36.461553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:36.462165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:36.463541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:36.464225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:36.687998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:36.688963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:36.699361 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:36.700228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:36.701436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:36.702159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:36.737425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:36.754661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:36.762510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:36.763771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e42298c-a2e1-4258-9e94-3bbe6998576a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.321767 Dec 02 15:52:36.764395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 327/614] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:36 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:36.915021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:36.923862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2f573f67-8a38-4c2d-879c-4fe3a0abbaf2 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1311 microversion: 2.1 time: 0.254757 Dec 02 15:52:36.925313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 288/615] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:36 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1311 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:37.468989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:37.470002 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:37.500552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:37.501287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:37.502760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:37.504062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:37.707716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1602015599", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274750580", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2048584045"}], "block_device_mapping_v2": [{"uuid": "18083daf-f7cb-4e3e-aea1-bd63268e1a09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:38.310730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] validate_networks() for [('fb4a3f3f-f009-42fb-af5a-e60d7446ffbb', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:52:38.345598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d6db0f22-1c77-4400-b472-47dc49fbd16e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/os-volume_attachments/c0b02786-a75d-44b1-ac01-8eb2e421151b" status: 202 len: 0 microversion: 2.1 time: 0.907556 Dec 02 15:52:38.346831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 328/616] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:52:37 2020] DELETE /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/os-volume_attachments/c0b02786-a75d-44b1-ac01-8eb2e421151b => generated 0 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:52:38.374707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:38.376416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:38.394680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:38.395510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:38.397039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:38.397625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:38.726614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:38.747279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:38.754425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:38.755685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7b604b13-4415-4592-a7ee-2d2250ec58be tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.406509 Dec 02 15:52:38.756342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 329/617] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:38 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:38.773973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:38.774641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:38.783557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:38.784097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:38.784989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:38.785476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:38.871418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:38.871922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:38.872496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lazy-loading 'fault' on Instance uuid 151ef38d-ba70-4859-93d6-24b1aad15e27 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:52:38.996088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b2b57e9310b48d19cc45c504b90eb4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbb7ca3f3664f78b99b77c653d6109a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:39.006022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6f4a0e45-0f57-4f99-8a75-64c79e71b0f4 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 200 len: 1316 microversion: 2.1 time: 0.248502 Dec 02 15:52:39.006743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 330/618] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:38 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:39.078410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:52:39.078899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:52:39.079446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:52:39.079910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:52:39.080406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:52:39.090735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:39.091250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:39.092197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:39.092698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:39.114339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for project e84bacbd36bc4a75898431f75ffae141. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:52:39.120480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for user d269a2a6f71e40538a8b7b7a199ec693 and project e84bacbd36bc4a75898431f75ffae141. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:52:39.238365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:52:39.241103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18083daf-f7cb-4e3e-aea1-bd63268e1a09',volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:52:39.782059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:39.782613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:39.791710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:39.792244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:39.793090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:39.793578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:40.053236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:40.073724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:40.082700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:40.100019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dcbf0090-b8bc-4e17-be0a-90d463bc5189 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.312285 Dec 02 15:52:40.100019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 331/619] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:39 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:52:40.100019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:40.100019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] [instance: 151ef38d-ba70-4859-93d6-24b1aad15e27] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:40.110392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:40.111333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:40.112621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:40.113397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:40.180834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] HTTP exception thrown: Instance 151ef38d-ba70-4859-93d6-24b1aad15e27 could not be found. Dec 02 15:52:40.183021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] Returning 404 to user: Instance 151ef38d-ba70-4859-93d6-24b1aad15e27 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:52:40.184227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0a7c9e3c-ff82-4e61-a7d6-94cfdab6d846 tempest-ServerRescueNegativeTestJSON-1367507406 tempest-ServerRescueNegativeTestJSON-1367507406] 10.222.0.101 "GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27" status: 404 len: 111 microversion: 2.1 time: 0.098135 Dec 02 15:52:40.185449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 332/620] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:40 2020] GET /compute/v2.1/servers/151ef38d-ba70-4859-93d6-24b1aad15e27 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:52:40.571082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b43492e9-623a-4a18-b1b2-ac2f8677460c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 415 microversion: 2.1 time: 2.873294 Dec 02 15:52:40.576376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 289/621] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:52:37 2020] POST /compute/v2.1/servers => generated 415 bytes in 2879 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:52:40.589636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1cb683f0-8ecb-4081-83c0-fcae813a2ab4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:40.594851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1cb683f0-8ecb-4081-83c0-fcae813a2ab4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:40.718926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1cb683f0-8ecb-4081-83c0-fcae813a2ab4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:40.735988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1cb683f0-8ecb-4081-83c0-fcae813a2ab4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1097 microversion: 2.1 time: 0.156869 Dec 02 15:52:40.737227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 333/622] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:40 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1097 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:41.130572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:41.131144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:41.142298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:41.142788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:41.144071 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:41.144575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:41.616439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:41.649346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:41.663765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:41.665054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f1102a27-6d95-4436-a952-194fc5c6ece3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.550566 Dec 02 15:52:41.666323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 290/623] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:41 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:41.760619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:41.761361 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:41.770773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:41.771413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:41.772410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:41.772991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:42.047126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:42.066000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-17695aab-baf2-4819-80be-1e6373f61324 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1147 microversion: 2.1 time: 0.314725 Dec 02 15:52:42.066616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 334/624] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:41 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1147 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:42.691280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:42.691947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:42.700614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:42.701121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:42.702001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:42.702498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:43.107734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:43.108441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:43.111078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:43.129287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:43.131435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:43.132560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:43.137856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:43.175548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:43.185082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:43.186684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ffc7cf73-301d-416e-890a-758fc146061a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.504869 Dec 02 15:52:43.187452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 291/625] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:42 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:43.314133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:43.323995 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-88786c59-5c65-4508-b216-f1961b68c5be tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1147 microversion: 2.1 time: 0.235301 Dec 02 15:52:43.324608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 335/626] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:43 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1147 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:44.215179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:44.216257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:44.226038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:44.226583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:44.228361 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:44.229739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:44.349353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:44.350022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:44.367397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:44.369803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:44.371261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:44.372029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:44.534571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:44.544396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0f76a155-3bf5-4cf6-b2d9-e38b692ac396 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1195 microversion: 2.1 time: 0.205516 Dec 02 15:52:44.545396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 336/627] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:44 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1195 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:44.713640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:44.736490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:44.746423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:44.748155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5344987f-291a-48d1-9acd-c81e72bf013f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.545046 Dec 02 15:52:44.749020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 292/628] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:44 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:45.579260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:45.580597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:45.598583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:45.599670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:45.601553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:45.602479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:45.800580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:45.802302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:45.823457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:45.825179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:45.827746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:45.829751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:45.989926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:46.046664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a0744e53-67f6-401c-bb2a-ef784099a22e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1213 microversion: 2.1 time: 0.486175 Dec 02 15:52:46.047734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 337/629] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:45 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1213 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:46.995651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:47.030593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:47.049430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:47.052017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-525d40c8-2470-4b3f-b38e-e7e4b3d99555 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 1.285873 Dec 02 15:52:47.053061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 293/630] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:45 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:47.107534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:47.108459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:47.117473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:47.117946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:47.124259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:47.124933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:47.340288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:47.362608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6409ae6f-1a0c-488a-b4dc-4a8296796f5e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1213 microversion: 2.1 time: 0.276121 Dec 02 15:52:47.376024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 338/631] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:47 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1213 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:48.112983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:48.115090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:48.132271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:48.133464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:48.136878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:48.142954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:48.404465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:48.405633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:48.414460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:48.415678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:48.416829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:48.417414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:48.863401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:48.874857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-589e97c3-f122-4cbb-896f-e3956005c9f0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1288 microversion: 2.1 time: 0.483962 Dec 02 15:52:48.875710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 339/632] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:48 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1288 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:49.132550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:49.154870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:49.169023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:49.171218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-20cc5ab5-706b-44d4-82b2-5f6ee6d0cd95 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 1.087370 Dec 02 15:52:49.183043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 294/633] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:48 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:49.909597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:49.910449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:49.920084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:49.920714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:49.921783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:49.922378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:50.203079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:50.203933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:50.225178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:50.225698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:50.226589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:50.227093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:50.651765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:50.675438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:50.693465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:50.693881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c566e176-94a6-4cc3-b0aa-9e46b5f035f7 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1288 microversion: 2.1 time: 0.794459 Dec 02 15:52:50.697145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 340/634] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:49 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1288 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:50.713781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:50.715238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-168ef5db-b7ce-4403-addf-0b19dcedd27a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.526999 Dec 02 15:52:50.715952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 295/635] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:50 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:52:50.738355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-79cd8cc3-569e-43b0-b6b9-7a72884fe4b0 req-24af70a9-3411-4ed9-9ce1-79c64bfd892d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "name": "network-vif-plugged", "status": "completed", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:50.746051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:50.746051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:50.755861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-79cd8cc3-569e-43b0-b6b9-7a72884fe4b0 req-24af70a9-3411-4ed9-9ce1-79c64bfd892d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:50.759596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-79cd8cc3-569e-43b0-b6b9-7a72884fe4b0 req-24af70a9-3411-4ed9-9ce1-79c64bfd892d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:50.779179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-79cd8cc3-569e-43b0-b6b9-7a72884fe4b0 req-24af70a9-3411-4ed9-9ce1-79c64bfd892d service nova] Creating event network-vif-plugged:f1a284ff-0f4c-48d6-b0e8-b35db079365a for instance a5112b52-9227-41cf-a36c-19e97dd4222c on hv-cinder-73761 Dec 02 15:52:50.785472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-79cd8cc3-569e-43b0-b6b9-7a72884fe4b0 req-24af70a9-3411-4ed9-9ce1-79c64bfd892d service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066864 Dec 02 15:52:50.786273 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 341/636] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:50 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:52:51.737304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:51.738487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:51.751665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:51.764764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:51.765112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:51.765312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:51.766065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:51.770153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:51.790723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:51.792807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:51.793895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:51.794444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:52.236080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:52.253394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-64d864b9-342b-409c-b0fc-b6232add1dcc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1288 microversion: 2.1 time: 0.541340 Dec 02 15:52:52.254267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 296/637] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:51 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1288 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:52.285519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-26b427a0-8902-4e2b-b773-f0962ff6c858 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:52.293727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26b427a0-8902-4e2b-b773-f0962ff6c858 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:52.294343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26b427a0-8902-4e2b-b773-f0962ff6c858 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:52.403848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-26b427a0-8902-4e2b-b773-f0962ff6c858 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Going to try to stop instance {{(pid=94391) force_stop /opt/stack/nova/nova/compute/api.py:2576}} Dec 02 15:52:52.607172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:52.630818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:52.641177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:52.643048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c93545a3-ad0a-4fb3-9ded-ba9202268956 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.907895 Dec 02 15:52:52.655771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 342/638] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:51 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:52.681016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-26b427a0-8902-4e2b-b773-f0962ff6c858 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.414882 Dec 02 15:52:52.682895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 297/639] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:52:52 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:52:52.694668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-5af9441b-5a0e-453c-ba93-5cb7d50b18bb req-c5dc0143-24bd-41fc-889f-acee31f6a177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6186d2-2516-45ad-b5a8-659eda7064a7", "tag": "fc8dafcb-64d1-4db0-a5fe-998da66496fc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:52:52.703679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:52:52.703679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:52:52.723567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5af9441b-5a0e-453c-ba93-5cb7d50b18bb req-c5dc0143-24bd-41fc-889f-acee31f6a177 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:52.723567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5af9441b-5a0e-453c-ba93-5cb7d50b18bb req-c5dc0143-24bd-41fc-889f-acee31f6a177 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:52.738324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:52.748027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:52.761058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-5af9441b-5a0e-453c-ba93-5cb7d50b18bb req-c5dc0143-24bd-41fc-889f-acee31f6a177 service nova] Creating event network-changed:fc8dafcb-64d1-4db0-a5fe-998da66496fc for instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 on hv-cinder-73761 Dec 02 15:52:52.767355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:52.768111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:52.769440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-5af9441b-5a0e-453c-ba93-5cb7d50b18bb req-c5dc0143-24bd-41fc-889f-acee31f6a177 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091126 Dec 02 15:52:52.769960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:52.770461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:52.771105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 343/640] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:52:52 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:52:53.262784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:53.282914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:53.291651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:53.302582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bfe8c47c-1a28-4a8c-a932-f02f6e71b954 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.614238 Dec 02 15:52:53.318747 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 298/641] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:52 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:53.329535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:53.329535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:53.334737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:53.334737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:53.675238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:53.687737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:53.752820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:53.763243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:53.775327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:53.776721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:54.009936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:54.035284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f8bcce14-e909-430e-9ca7-43784d3a92e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.764157 Dec 02 15:52:54.036398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 344/642] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:53 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:54.275952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:54.297899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:54.306437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:54.308008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c31c7ac4-6f87-4fc7-8c46-c67ccd2121e2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.646090 Dec 02 15:52:54.308836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 299/643] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:53 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:54.359655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:54.361020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:54.376834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:54.380280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:54.380280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:54.380492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:54.915916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:54.934849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:54.936345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:54.941935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9ec72fd7-7ad1-4a2d-871b-cc797e90bdb0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.602720 Dec 02 15:52:54.944244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 345/644] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:54 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:54.963131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:54.963592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:54.964784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:54.965387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:55.083740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:55.090624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:55.146575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:55.146950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:55.148035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:55.148683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:55.471051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-53719b6c-09b1-4912-ae4a-b43fe50f9ecc tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "DELETE /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10/os-volume_attachments/bf58f292-6779-463e-91ae-7e123365f0c9" status: 202 len: 0 microversion: 2.1 time: 0.558532 Dec 02 15:52:55.478755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 300/645] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:52:54 2020] DELETE /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10/os-volume_attachments/bf58f292-6779-463e-91ae-7e123365f0c9 => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:52:55.528283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:55.535127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:55.559355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:55.561175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:55.563031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:55.577662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:56.074743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:56.116009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af9b0795-4cdf-4826-b012-61b166116378 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 1.064368 Dec 02 15:52:56.116622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 346/646] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:55 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:56.150380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:56.155943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:56.166078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:56.166580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:56.167427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:56.168487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:56.173181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:56.227197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:56.236069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:56.239926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a5047712-86de-4cd8-b24d-d3af083fb341 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1811 microversion: 2.20 time: 0.756281 Dec 02 15:52:56.239926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 301/647] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:55 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1811 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:56.663113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:56.674037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-51794d92-88a9-4ffd-bbe0-d056ce001f7d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.540427 Dec 02 15:52:56.674859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 347/648] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:56 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:57.152293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:57.154902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:57.173561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:57.174559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:57.176504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:57.177713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:57.276749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:57.277300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:57.290554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:57.290862 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:57.291578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:57.292132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:57.576962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:57.597123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:57.611914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-82ff2633-9311-4f7d-af76-1a80544f0646 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.480296 Dec 02 15:52:57.612957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 302/649] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:57 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:57.618922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:57.626009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:57.627610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bf8b30c3-c7b3-48d1-9c14-04b4a60ecc70 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1798 microversion: 2.20 time: 0.372745 Dec 02 15:52:57.628435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 348/650] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:52:57 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1798 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:52:57.699177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:57.699854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:57.707931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:57.708478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:57.709389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:57.709871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:57.964405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:57.978329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8749103b-ff08-487a-84d2-6c658eba13ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.288490 Dec 02 15:52:57.978964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 303/651] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:57 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:52:58.082577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:58.083431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:58.094639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:58.095366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:58.096463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:58.097157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:58.192880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:52:58.499785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8fa93ef4-5ae5-410c-81d3-580c3ea043d6 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "DELETE /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 204 len: 0 microversion: 2.1 time: 0.427396 Dec 02 15:52:58.500909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 349/652] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:52:58 2020] DELETE /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:52:58.516570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:58.517323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:58.526923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:58.527431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:58.528323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:58.528933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:58.639539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:58.640856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:58.651253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:58.651752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:58.652640 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:58.653138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:58.893714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:58.903867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ab966e8a-6046-49d6-871a-a66ebf3b4b62 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.277058 Dec 02 15:52:58.904528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 350/653] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:58 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:58.991495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:59.001143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c8d796fe-9623-4048-b719-72fb48557c11 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1519 microversion: 2.1 time: 0.495373 Dec 02 15:52:59.001668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 304/654] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:58 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1519 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:59.002430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:59.003118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:59.013776 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:59.014288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:59.015142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:59.015636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:59.273695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:52:59.292844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b7a212b5-584b-4bb0-9397-7a99434f256c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.299536 Dec 02 15:52:59.293449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 351/655] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:58 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:52:59.928173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:52:59.928854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:52:59.937614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:59.938129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:52:59.939024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:52:59.939514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:00.032313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:00.033207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:00.043222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:00.043835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:00.044711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:00.045398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:00.307066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:00.316603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-50327693-1b05-4d87-9f9f-4b1caa9ec2d4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1519 microversion: 2.1 time: 0.298675 Dec 02 15:53:00.317218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 352/656] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:00 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1519 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:00.328116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:00.328794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:00.339909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:00.340462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:00.341204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:00.341569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:00.381108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:00.393134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8f1c0f27-4e2e-482e-926f-9b74f4dca96c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.474577 Dec 02 15:53:00.394437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 305/657] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:52:59 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:00.621920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:00.637493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1caaf051-6607-4ffb-b849-e22b261b0adb tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.319083 Dec 02 15:53:00.638694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 353/658] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:00 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:01.341398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:01.342125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:01.350527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:01.351035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:01.351880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:01.352435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:01.423449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:01.424366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:01.433620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:01.434137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:01.435180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:01.435683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:01.611792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:01.622940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-771756c4-674e-4b2a-8874-f2e115194915 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1519 microversion: 2.1 time: 0.291111 Dec 02 15:53:01.623643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 306/659] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:01 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1519 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:01.662989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:01.665068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:01.673964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:01.674599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:01.675583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:01.676196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:02.016028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:02.027462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3872b653-187d-4368-81bd-5f71e0e373e4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 0.374507 Dec 02 15:53:02.028514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 307/660] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:01 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:02.073986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:02.118929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42b1baa9-1aa9-4456-9d5f-ca26d16d9cd1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.707733 Dec 02 15:53:02.120446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 354/661] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:01 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:02.647638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:02.648468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:02.657490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:02.658200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:02.659219 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:02.659821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:02.908664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:02.918922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1bdace11-5538-4446-9786-5f7283d5323a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1519 microversion: 2.1 time: 0.280634 Dec 02 15:53:02.919686 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 308/662] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:02 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:03.055744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:03.056600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:03.069748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:03.106270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:03.107310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:03.107825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:03.174743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:03.175662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:03.191043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:03.193153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:03.198090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:03.199773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:03.568462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:03.579920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-baf1a899-ded8-4360-849d-0d6935b25d0d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.444436 Dec 02 15:53:03.580937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 309/663] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:03 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:03.947282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:03.947957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:03.957488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:03.958295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:03.959430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:03.960564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:04.341818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:04.341999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:04.363328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-77607a88-8b93-41d9-9727-77e8d5d3a212 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1519 microversion: 2.1 time: 0.417021 Dec 02 15:53:04.363328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 310/664] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:03 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:04.363678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-23132dbf-778d-4719-af0b-9414f51218f4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1678 microversion: 2.1 time: 1.310508 Dec 02 15:53:04.364448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 355/665] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:03 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1678 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:04.364979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-59f32ed7-1ceb-4959-8826-eac66dad4ea2 req-40a0d01a-3428-481a-ad09-5b219bcb1326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6186d2-2516-45ad-b5a8-659eda7064a7", "name": "network-vif-plugged", "status": "completed", "tag": "fc8dafcb-64d1-4db0-a5fe-998da66496fc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:04.373142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:53:04.373142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:53:04.384230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-59f32ed7-1ceb-4959-8826-eac66dad4ea2 req-40a0d01a-3428-481a-ad09-5b219bcb1326 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:04.384835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-59f32ed7-1ceb-4959-8826-eac66dad4ea2 req-40a0d01a-3428-481a-ad09-5b219bcb1326 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:04.415847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-59f32ed7-1ceb-4959-8826-eac66dad4ea2 req-40a0d01a-3428-481a-ad09-5b219bcb1326 service nova] Creating event network-vif-plugged:fc8dafcb-64d1-4db0-a5fe-998da66496fc for instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 on hv-cinder-73761 Dec 02 15:53:04.429459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-59f32ed7-1ceb-4959-8826-eac66dad4ea2 req-40a0d01a-3428-481a-ad09-5b219bcb1326 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072647 Dec 02 15:53:04.431665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 311/666] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:53:04 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:04.605141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:04.605822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:04.614314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:04.614720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:04.615724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:04.619967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:05.096962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:05.146555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-87756f05-3a9e-4081-8b12-45b6f836f9e0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.540928 Dec 02 15:53:05.146555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 356/667] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:04 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:05.379857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:05.380153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:05.380581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:05.381097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:05.390518 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:05.390945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:05.391110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:05.391596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:05.391869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:05.392390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:05.392853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:05.393412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:05.879299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:05.905818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d4f43b6c-4f8d-4346-8072-abf3c6db8552 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1655 microversion: 2.1 time: 0.533912 Dec 02 15:53:05.907345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 312/668] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:05 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1655 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:05.948468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d2e2c6b0-f21d-4abd-92f6-e9853382a541 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:05.957626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d2e2c6b0-f21d-4abd-92f6-e9853382a541 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:05.958137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d2e2c6b0-f21d-4abd-92f6-e9853382a541 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:06.020995 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:06.047541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d2e2c6b0-f21d-4abd-92f6-e9853382a541 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Going to try to start instance {{(pid=94391) start /opt/stack/nova/nova/compute/api.py:2599}} Dec 02 15:53:06.049541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cd6607a4-4394-46b5-8806-bcef3f973728 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1519 microversion: 2.1 time: 0.678942 Dec 02 15:53:06.052048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 357/669] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:05 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1519 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:06.169164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:06.172935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:06.206244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:06.219246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:06.219246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:06.220444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:06.390751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d2e2c6b0-f21d-4abd-92f6-e9853382a541 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action" status: 202 len: 0 microversion: 2.1 time: 0.452110 Dec 02 15:53:06.398512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 313/670] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:53:05 2020] POST /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:53:06.434392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:06.435202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:06.458511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:06.459034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:06.460024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:06.460449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:06.772904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:06.783854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-03e44f4d-0635-4fa8-8405-de3d1a3be5a9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1664 microversion: 2.1 time: 0.377753 Dec 02 15:53:06.784665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 314/671] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:06 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1664 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:06.796614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-3d9dd0d2-6424-4e58-90fa-7c102ce4ee96 req-956d1f92-e2c2-44c8-933f-96fc734bcc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a98e87c-b99a-4510-aa3d-700dab85ae10", "name": "network-vif-unplugged", "status": "completed", "tag": "b6a667d0-da4b-4185-a6eb-1abe0455d2c8"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:06.804522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:53:06.804522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:53:06.815277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-3d9dd0d2-6424-4e58-90fa-7c102ce4ee96 req-956d1f92-e2c2-44c8-933f-96fc734bcc62 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:06.816122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-3d9dd0d2-6424-4e58-90fa-7c102ce4ee96 req-956d1f92-e2c2-44c8-933f-96fc734bcc62 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:06.830370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:06.852456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-831004d7-d0d4-4b87-b3f8-b250c6bfaf07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1276 microversion: 2.1 time: 0.690556 Dec 02 15:53:06.858503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-3d9dd0d2-6424-4e58-90fa-7c102ce4ee96 req-956d1f92-e2c2-44c8-933f-96fc734bcc62 service nova] Creating event network-vif-unplugged:b6a667d0-da4b-4185-a6eb-1abe0455d2c8 for instance 3a98e87c-b99a-4510-aa3d-700dab85ae10 on hv-cinder-73761 Dec 02 15:53:06.859786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 358/672] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:06 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1276 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:06.865093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-3d9dd0d2-6424-4e58-90fa-7c102ce4ee96 req-956d1f92-e2c2-44c8-933f-96fc734bcc62 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078234 Dec 02 15:53:06.874079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 315/673] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:53:06 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:07.077200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:07.078128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:07.087390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.088223 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:07.089279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.089924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:07.313488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:07.324413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6c818cec-6965-4ad5-88d8-719b2bd3ac36 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1477 microversion: 2.1 time: 0.257025 Dec 02 15:53:07.325742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 359/674] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:07 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:07.384767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-67713606-3b6b-4b08-a7ef-fd69484e095c req-4e0d4549-8238-4cf4-951e-2f43b73fc95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a98e87c-b99a-4510-aa3d-700dab85ae10", "name": "network-vif-deleted", "tag": "b6a667d0-da4b-4185-a6eb-1abe0455d2c8"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:07.394298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:53:07.394298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:53:07.405188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-67713606-3b6b-4b08-a7ef-fd69484e095c req-4e0d4549-8238-4cf4-951e-2f43b73fc95e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.405882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-67713606-3b6b-4b08-a7ef-fd69484e095c req-4e0d4549-8238-4cf4-951e-2f43b73fc95e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:07.427228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-67713606-3b6b-4b08-a7ef-fd69484e095c req-4e0d4549-8238-4cf4-951e-2f43b73fc95e service nova] Creating event network-vif-deleted:b6a667d0-da4b-4185-a6eb-1abe0455d2c8 for instance 3a98e87c-b99a-4510-aa3d-700dab85ae10 on hv-cinder-73761 Dec 02 15:53:07.434133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-67713606-3b6b-4b08-a7ef-fd69484e095c req-4e0d4549-8238-4cf4-951e-2f43b73fc95e service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067355 Dec 02 15:53:07.435113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 316/675] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:53:07 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:07.854295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:07.857651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:07.875943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.876892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:07.878443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.879612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:07.929095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:07.933796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:07.948548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.949061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:07.949940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:07.950434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:08.338651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:08.350187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4a63d54e-08d9-42cb-9de6-fd21fa93a09c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1464 microversion: 2.1 time: 0.452594 Dec 02 15:53:08.350994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 317/676] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:07 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1464 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:08.368988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:08.369793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:08.379630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:08.380321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:08.381152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:08.381679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:08.479781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:08.480561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:08.481261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lazy-loading 'fault' on Instance uuid 3a98e87c-b99a-4510-aa3d-700dab85ae10 {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:53:08.587637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:08.601993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ac51d495-e7ee-498b-a909-dba68f8a2afb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 200 len: 1313 microversion: 2.1 time: 0.249818 Dec 02 15:53:08.613997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 318/677] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:08 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:08.630184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:08.636822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:08.647558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:08.648369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:08.650254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:08.650731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:08.777872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:08.797502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0668fe5c-b4cc-41ec-9d09-9b45a04f2678 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1664 microversion: 2.1 time: 0.989428 Dec 02 15:53:08.798218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 360/678] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:07 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1664 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:09.306291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:09.316241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-105b86e6-e805-4e18-8b06-11dadd015787 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1464 microversion: 2.1 time: 0.700818 Dec 02 15:53:09.316857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 319/679] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:08 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1464 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:09.349811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0b6481de-682f-45b9-a3ed-9a7984f6070a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f0270691bf8>, body: {"pool": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:09.643151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:09.644058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 3a98e87c-b99a-4510-aa3d-700dab85ae10] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:09.658426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:09.658426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:09.658856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:09.659547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:09.749447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] HTTP exception thrown: Instance 3a98e87c-b99a-4510-aa3d-700dab85ae10 could not be found. Dec 02 15:53:09.750744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Returning 404 to user: Instance 3a98e87c-b99a-4510-aa3d-700dab85ae10 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:53:09.751748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-71fee523-a2dd-4fc0-99ba-0847c2954cb5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10" status: 404 len: 111 microversion: 2.1 time: 0.125216 Dec 02 15:53:09.752595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 320/680] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:09 2020] GET /compute/v2.1/servers/3a98e87c-b99a-4510-aa3d-700dab85ae10 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:53:09.835719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:09.835719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:09.858352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:09.859285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:09.860745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:09.861653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:11.189609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:11.201867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-218e1b4e-249c-4472-9ccb-ebf8dedaf14a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1668 microversion: 2.1 time: 1.388890 Dec 02 15:53:11.215423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 321/681] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:09 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1668 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:53:11.728974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 15:53:11.728974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 15:53:11 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-floating-ips (ip 10.222.0.101) !!! Dec 02 15:53:12.977297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0b6481de-682f-45b9-a3ed-9a7984f6070a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.637134 Dec 02 15:53:12.978792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 361/682] 10.222.0.101 () {60 vars in 1165 bytes} [Wed Dec 2 15:53:09 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:12.996881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'action', calling method: .version_select at 0x7f027202e048>, body: {"addFloatingIp": {"address": "172.27.0.249"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:12.998420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:13.006656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:13.007364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:13.009295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:13.010110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:13.107730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Acquired lock "refresh_cache-7c6186d2-2516-45ad-b5a8-659eda7064a7" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:53:15.844417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Building network info cache for instance {{(pid=94391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 15:53:15.910207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-4dc69340-8397-4d45-a710-4252768b9d34 req-d0d70d73-4037-4b19-ac97-f4a1c4fd77db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c6186d2-2516-45ad-b5a8-659eda7064a7", "tag": "fc8dafcb-64d1-4db0-a5fe-998da66496fc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:15.920817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:53:15.920817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:53:15.932690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-4dc69340-8397-4d45-a710-4252768b9d34 req-d0d70d73-4037-4b19-ac97-f4a1c4fd77db service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:15.933914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-4dc69340-8397-4d45-a710-4252768b9d34 req-d0d70d73-4037-4b19-ac97-f4a1c4fd77db service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:15.959036 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-4dc69340-8397-4d45-a710-4252768b9d34 req-d0d70d73-4037-4b19-ac97-f4a1c4fd77db service nova] Creating event network-changed:fc8dafcb-64d1-4db0-a5fe-998da66496fc for instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 on hv-cinder-73761 Dec 02 15:53:15.964938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-4dc69340-8397-4d45-a710-4252768b9d34 req-d0d70d73-4037-4b19-ac97-f4a1c4fd77db service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063643 Dec 02 15:53:15.966120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 362/683] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:53:15 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:17.286326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Updating instance_info_cache with network_info: [{"id": "fc8dafcb-64d1-4db0-a5fe-998da66496fc", "address": "fa:16:3e:f6:d4:e8", "network": {"id": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1674399377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e84bacbd36bc4a75898431f75ffae141", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapfc8dafcb-64", "ovs_interfaceid": "fc8dafcb-64d1-4db0-a5fe-998da66496fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 15:53:17.336621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Releasing lock "refresh_cache-7c6186d2-2516-45ad-b5a8-659eda7064a7" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:53:17.336923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-621e998c-d551-46ce-884d-1f504d489f29 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7/action" status: 202 len: 0 microversion: 2.1 time: 4.350455 Dec 02 15:53:17.337749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 322/684] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:53:12 2020] POST /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7/action => generated 0 bytes in 4352 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 02 15:53:21.456565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-95163463", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "networks": [{"uuid": "5072836c-1689-4769-8096-b0a206a7686f"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:21.536804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] validate_networks() for [('5072836c-1689-4769-8096-b0a206a7686f', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:53:22.428596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:53:22.429074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:53:22.430292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:53:22.430941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:53:22.431410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:53:22.440780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:22.441288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:22.442166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:22.442663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:22.462729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Getting quotas for project 229596ae42204d5ead3f32ea7ab04bad. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:53:22.467176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Getting quotas for user 361cc487f5a44c18b7c365738b6e4ccc and project 229596ae42204d5ead3f32ea7ab04bad. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:53:22.479167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:53:22.481973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:53:22.645383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c8d18732-d144-4885-9394-497b88aa7c84 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.198471 Dec 02 15:53:22.652297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 363/685] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:53:21 2020] POST /compute/v2.1/servers => generated 382 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:53:22.662802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-207ed2f7-a94b-499b-afd0-474b86a0aaab tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:22.663470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-207ed2f7-a94b-499b-afd0-474b86a0aaab tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:22.753205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-207ed2f7-a94b-499b-afd0-474b86a0aaab tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:22.762679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-207ed2f7-a94b-499b-afd0-474b86a0aaab tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1221 microversion: 2.1 time: 0.109030 Dec 02 15:53:22.763296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 323/686] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:22 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:23.786760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:23.787428 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:23.796493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:23.797005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:23.797860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:23.798351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:23.937192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:23.946986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-267d5361-7c9b-48a4-b0a6-bfaace444b05 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1217 microversion: 2.1 time: 0.170023 Dec 02 15:53:23.947692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 364/687] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:23 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:24.993639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:24.994538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:25.009905 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:25.010727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:25.012062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:25.012844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:25.227024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:25.245130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2e5434ce-fb2c-44f1-8986-03d67253561e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1273 microversion: 2.1 time: 0.274102 Dec 02 15:53:25.246298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 324/688] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:24 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:26.270430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:26.271106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:26.280797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:26.281153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:26.281779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:26.282271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:26.442582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:26.453837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-17f780cb-2122-46c6-8708-9a2467ec4a3e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1273 microversion: 2.1 time: 0.192786 Dec 02 15:53:26.454466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 365/689] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:26 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:27.486944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:27.487606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:27.499037 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:27.500186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:27.501130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:27.501634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:27.684709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:27.696473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a697f922-5074-4f09-bdea-6d9711047c47 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1281 microversion: 2.1 time: 0.222981 Dec 02 15:53:27.697740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 325/690] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:27 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:28.723666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:28.725087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:28.734329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:28.734939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:28.735896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:28.736660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:29.040709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:29.060284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5fb613f0-3fe6-474f-a960-3312f70a7ab4 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.346967 Dec 02 15:53:29.061329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 366/691] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:28 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:30.096764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:30.097821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:30.117110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:30.117746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:30.118702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:30.119930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:30.827005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:30.842677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4a3e4bc8-1812-445c-961c-39232ddb3737 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.759437 Dec 02 15:53:30.844595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 326/692] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:30 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:31.641238 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-92d8227d-659d-499a-96b0-d438dea021fe req-5c07a672-2626-4264-8727-97114f046c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c360ff-af0d-4210-a295-00447d5ed811", "tag": "04beb8fe-6bf8-421f-a893-abffa9c2bb1d"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:31.652407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:53:31.652407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:53:31.664690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-92d8227d-659d-499a-96b0-d438dea021fe req-5c07a672-2626-4264-8727-97114f046c2d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:31.665334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-92d8227d-659d-499a-96b0-d438dea021fe req-5c07a672-2626-4264-8727-97114f046c2d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:31.683922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-92d8227d-659d-499a-96b0-d438dea021fe req-5c07a672-2626-4264-8727-97114f046c2d service nova] Creating event network-changed:04beb8fe-6bf8-421f-a893-abffa9c2bb1d for instance 47c360ff-af0d-4210-a295-00447d5ed811 on hv-cinder-73761 Dec 02 15:53:31.689362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-92d8227d-659d-499a-96b0-d438dea021fe req-5c07a672-2626-4264-8727-97114f046c2d service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057726 Dec 02 15:53:31.690266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 367/693] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:53:31 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:31.871915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:31.872636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:31.881509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:31.882616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:31.883913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:31.884435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:32.282202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:32.291590 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c078f053-5c0e-4dfd-83d9-e45c0a5a79ce tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.430219 Dec 02 15:53:32.292565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 327/694] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:31 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:33.317609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:33.318299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:33.327293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:33.327836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:33.328711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:33.329200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:33.570930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:33.580029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ebdf62ea-64f9-40b0-982f-ac25d16b8d67 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.272688 Dec 02 15:53:33.580792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 368/695] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:33 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:34.605765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:34.606544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:34.615789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:34.616850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:34.618458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:34.618968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:34.853146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:34.861986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a6624cc6-6394-4009-9185-73dbb43ed16c tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.266506 Dec 02 15:53:34.862587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 328/696] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:34 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:35.887085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:35.887662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:35.895622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:35.896164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:35.897001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:35.897993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:36.138041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:36.147723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cae1f453-abdf-40f4-b8a9-d87bf358b0cb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.270742 Dec 02 15:53:36.148500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 369/697] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:35 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:37.171514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:37.172218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:37.180401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:37.180915 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:37.181768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:37.182262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:37.415601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:37.424354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-11904986-9b8a-4f32-b399-367147b322eb tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.262197 Dec 02 15:53:37.424951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 329/698] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:37 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:38.448185 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:38.448846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:38.456719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:38.457225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:38.458049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:38.458537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:38.688956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:38.698477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5658529a-c56d-41aa-90f6-ee789914950a tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.259552 Dec 02 15:53:38.699211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 370/699] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:38 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:39.231916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-099a0d48-f232-4efb-b7f3-574561d77bd8 req-decdd70a-3d5d-4dde-a33d-470e267f5d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c360ff-af0d-4210-a295-00447d5ed811", "name": "network-vif-plugged", "status": "completed", "tag": "04beb8fe-6bf8-421f-a893-abffa9c2bb1d"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:39.239514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:53:39.239514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:53:39.250476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-099a0d48-f232-4efb-b7f3-574561d77bd8 req-decdd70a-3d5d-4dde-a33d-470e267f5d09 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:39.250981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-099a0d48-f232-4efb-b7f3-574561d77bd8 req-decdd70a-3d5d-4dde-a33d-470e267f5d09 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:39.274117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-099a0d48-f232-4efb-b7f3-574561d77bd8 req-decdd70a-3d5d-4dde-a33d-470e267f5d09 service nova] Creating event network-vif-plugged:04beb8fe-6bf8-421f-a893-abffa9c2bb1d for instance 47c360ff-af0d-4210-a295-00447d5ed811 on hv-cinder-73761 Dec 02 15:53:39.280095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-099a0d48-f232-4efb-b7f3-574561d77bd8 req-decdd70a-3d5d-4dde-a33d-470e267f5d09 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059499 Dec 02 15:53:39.281328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 330/700] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:53:39 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:39.723277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:39.724258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:39.733367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:39.734054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:39.735089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:39.735691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:39.990724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:40.002458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ca091c34-2eb7-4ddf-bca6-145767ebe556 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.289053 Dec 02 15:53:40.003378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 371/701] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:39 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:41.029369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:41.030158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:41.039466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:41.040141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:41.041051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:41.041553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:41.282728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:41.291564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7326cd94-04aa-4e1f-aa38-0d901881f762 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.272844 Dec 02 15:53:41.292441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 331/702] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:41 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:42.316009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:42.316687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:42.326029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:42.326029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:42.326842 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:42.327375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:42.552469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:42.561984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ed91f603-4df8-4ace-9c0e-7d358201340f tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.255829 Dec 02 15:53:42.562583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 372/703] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:42 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:43.587010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:43.587821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:43.597000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:43.597520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:43.598397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:43.598898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:43.852349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:43.863547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c8987443-2583-46a9-82b5-07f38717f255 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1321 microversion: 2.1 time: 0.286580 Dec 02 15:53:43.864457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 332/704] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:43 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:44.888570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:44.889261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:44.897547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:44.898100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:44.898916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:44.899410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:45.145755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:53:45.158485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7ec24c3d-c144-4190-9062-cc6c951f60fd tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1510 microversion: 2.1 time: 0.279987 Dec 02 15:53:45.159100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 373/705] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:53:44 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:53:45.182698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e744d185-87c5-4271-b82d-04a46d96c24e", "device": "/dev/sdb"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:53:45.183953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:45.193026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:45.193538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:45.194941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:45.195451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:48.069002 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5e5f3a2d-1c93-4cfa-9490-a14ba6001fe1 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "POST /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.895639 Dec 02 15:53:48.070812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 333/706] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:53:45 2020] POST /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811/os-volume_attachments => generated 194 bytes in 2899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:53:48.150860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:48.151377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:48.160684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:48.161093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:48.163261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:48.163736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:48.247476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d08f0d9b-ba40-431d-a2a2-e1bdf098bf12 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-volume_attachments/b18a11d5-0fef-4d97-beca-92b865922fc2" status: 200 len: 194 microversion: 2.20 time: 0.344198 Dec 02 15:53:48.248461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 374/707] 10.222.0.101 () {60 vars in 1449 bytes} [Wed Dec 2 15:53:47 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-volume_attachments/b18a11d5-0fef-4d97-beca-92b865922fc2 => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:53:48.402369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:53:48.403033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:53:48.413744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:48.414184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:48.415059 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:53:48.415552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:53:48.889768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4346b706-1ad6-4ac3-ad83-3286d29a53d9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-volume_attachments/b18a11d5-0fef-4d97-beca-92b865922fc2" status: 202 len: 0 microversion: 2.20 time: 0.497916 Dec 02 15:53:48.890479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 334/708] 10.222.0.101 () {60 vars in 1452 bytes} [Wed Dec 2 15:53:48 2020] DELETE /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c/os-volume_attachments/b18a11d5-0fef-4d97-beca-92b865922fc2 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:54:06.809319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:06.809991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:06.819786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:06.820889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:06.822953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:06.823840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:06.975539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:54:07.399354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f0a46ade-0922-45e8-8aa0-ced87d88b15b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 204 len: 0 microversion: 2.20 time: 0.600000 Dec 02 15:54:07.400535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 375/709] 10.222.0.101 () {60 vars in 1275 bytes} [Wed Dec 2 15:54:06 2020] DELETE /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 02 15:54:07.425226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:07.426043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:07.436569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:07.437391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:07.438416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:07.439541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:07.798623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:07.830150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:07.849666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:07.852396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1685cc85-bae8-436b-9106-ffadf4154bbe tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 0.446694 Dec 02 15:54:07.853940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 335/710] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:07 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:08.891407 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:08.893588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:08.922219 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:08.923163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:08.925150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:08.926061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:09.480353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:09.518453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:09.527294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:09.529225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d24394cd-b447-48ae-9277-6024a05c02cb tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 0.649126 Dec 02 15:54:09.530164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 376/711] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:08 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:10.572901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:10.574618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:10.600642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:10.601882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:10.604326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:10.605779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:11.025932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:11.068739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:11.084292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:11.088350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1be96e26-c6f6-4fb9-b6ba-c409806bac16 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 0.540852 Dec 02 15:54:11.089452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 336/712] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:10 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:11.330693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:11.332418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:11.351811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:11.356888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:11.356888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:11.356888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:11.540424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:54:12.193784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:12.196080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:12.249717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:12.252221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:12.256376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:12.261997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:12.320893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c1bd2497-8934-4c19-95d4-d6a20d94c153 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 204 len: 0 microversion: 2.1 time: 1.014195 Dec 02 15:54:12.322327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 377/713] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:54:11 2020] DELETE /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 0 bytes in 1018 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:54:12.383235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:12.383235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:12.451052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:12.452290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:12.453975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:12.454930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:13.110732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:13.168435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b462b233-f498-4aa7-ba37-193766ec0f60 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1674 microversion: 2.1 time: 0.839976 Dec 02 15:54:13.176509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 378/714] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:12 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1674 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:13.675157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:13.751450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:13.782941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:13.785705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e979358a-168c-4afd-8dee-19af941c20f3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 1.656364 Dec 02 15:54:13.806563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 337/715] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:12 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:14.220391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:14.223027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:14.233581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:14.234397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:14.235419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:14.236112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:14.612863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-105bf0e3-edaa-4291-a01b-16ec66b960ed req-c3527b63-23fd-44f0-a7ab-e957bbf75b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "name": "network-vif-unplugged", "status": "completed", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:14.645781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:54:14.645781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:54:14.691169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-105bf0e3-edaa-4291-a01b-16ec66b960ed req-c3527b63-23fd-44f0-a7ab-e957bbf75b21 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:14.692300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-105bf0e3-edaa-4291-a01b-16ec66b960ed req-c3527b63-23fd-44f0-a7ab-e957bbf75b21 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:14.789038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-105bf0e3-edaa-4291-a01b-16ec66b960ed req-c3527b63-23fd-44f0-a7ab-e957bbf75b21 service nova] Creating event network-vif-unplugged:f1a284ff-0f4c-48d6-b0e8-b35db079365a for instance a5112b52-9227-41cf-a36c-19e97dd4222c on hv-cinder-73761 Dec 02 15:54:14.815160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-105bf0e3-edaa-4291-a01b-16ec66b960ed req-c3527b63-23fd-44f0-a7ab-e957bbf75b21 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.786128 Dec 02 15:54:14.816563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 379/716] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:54:14 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:54:14.864611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:14.867035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:14.900171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:14.901097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:14.902833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:14.903635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:15.355272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:15.395005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b0350141-7c68-4e09-8ef4-f2e6d9267cba tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1674 microversion: 2.1 time: 1.210974 Dec 02 15:54:15.396666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 338/717] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:14 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1674 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:15.669357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:15.669924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:15.713291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:15.714130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:15.717767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:15.722488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:16.301481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:16.371192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:16.416938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:16.419909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c7e8143a-6bb7-443d-b6ae-b410c443bcfc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 1.595281 Dec 02 15:54:16.428304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 380/718] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:14 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:16.467165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:16.479266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:16.512098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:16.520612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:16.523587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:16.525009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:17.183721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f13ef74c-b692-4f97-aa31-59c570c8d117 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "DELETE /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811/os-volume_attachments/e744d185-87c5-4271-b82d-04a46d96c24e" status: 202 len: 0 microversion: 2.1 time: 1.519705 Dec 02 15:54:17.191660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 339/719] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:54:15 2020] DELETE /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811/os-volume_attachments/e744d185-87c5-4271-b82d-04a46d96c24e => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:54:17.329294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-eb021512-a257-448f-b412-f25a3a020298 req-8180f9cb-3cd3-417e-9a54-b0a100809cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b113cf-44c3-41ee-abfd-329c10e9e8e7", "name": "network-vif-unplugged", "status": "completed", "tag": "6c5618f4-d019-4723-9ad0-1720cd93ca07"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:17.360524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:54:17.360524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:54:17.412551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-eb021512-a257-448f-b412-f25a3a020298 req-8180f9cb-3cd3-417e-9a54-b0a100809cb8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:17.414437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-eb021512-a257-448f-b412-f25a3a020298 req-8180f9cb-3cd3-417e-9a54-b0a100809cb8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:17.499147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-eb021512-a257-448f-b412-f25a3a020298 req-8180f9cb-3cd3-417e-9a54-b0a100809cb8 service nova] Creating event network-vif-unplugged:6c5618f4-d019-4723-9ad0-1720cd93ca07 for instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 on hv-cinder-73761 Dec 02 15:54:17.527215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-eb021512-a257-448f-b412-f25a3a020298 req-8180f9cb-3cd3-417e-9a54-b0a100809cb8 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.331409 Dec 02 15:54:17.529033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 340/720] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:54:17 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:54:17.588009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:17.590356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:17.609240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:17.610759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:17.613561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:17.614917 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:18.628809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:18.660149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-876618fc-307c-4284-a787-6f5e94a078ea tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1674 microversion: 2.1 time: 2.228770 Dec 02 15:54:18.663199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 381/721] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:16 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1674 bytes in 2234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:19.639602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:19.684278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:19.697934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:19.698871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:19.711494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:19.713929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:19.717849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-66d0a58f-5cfe-48ca-a316-1df884f06261 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1726 microversion: 2.20 time: 2.181586 Dec 02 15:54:19.718522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 341/722] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:17 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1726 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:19.719134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:19.720645 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:19.721159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:20.613762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:20.616151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:20.633778 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:20.642822 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:20.646940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:20.652676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:20.758252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:54:21.058375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-79276310-50b2-4a83-8427-93308dc96416 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "DELETE /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 204 len: 0 microversion: 2.1 time: 0.458572 Dec 02 15:54:21.073350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 342/723] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:54:20 2020] DELETE /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:54:21.088166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:21.089474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:21.110757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:21.113943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:21.123455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:21.124542 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:21.910821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:22.007087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:22.014420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:22.022782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fb700295-ce2e-4483-8130-cf1f04435e36 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1658 microversion: 2.20 time: 0.961725 Dec 02 15:54:22.023682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 343/724] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:21 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1658 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:22.047930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:22.048662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:22.072971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:22.073489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:22.074370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:22.074868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:22.300973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:22.369418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5e0a3d07-3f8d-44b5-9d02-89080389c5a2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1674 microversion: 2.1 time: 2.682286 Dec 02 15:54:22.384230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 382/725] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:19 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1674 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:22.803649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-281346f0-f11b-4846-afeb-89aee89ba3fc req-df60e727-a1ac-43b1-ac8a-9215a2495ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5112b52-9227-41cf-a36c-19e97dd4222c", "name": "network-vif-deleted", "tag": "f1a284ff-0f4c-48d6-b0e8-b35db079365a"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:22.873537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:54:22.873537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:54:22.914870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-281346f0-f11b-4846-afeb-89aee89ba3fc req-df60e727-a1ac-43b1-ac8a-9215a2495ef8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:22.920885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-281346f0-f11b-4846-afeb-89aee89ba3fc req-df60e727-a1ac-43b1-ac8a-9215a2495ef8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:23.043448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-281346f0-f11b-4846-afeb-89aee89ba3fc req-df60e727-a1ac-43b1-ac8a-9215a2495ef8 service nova] Creating event network-vif-deleted:f1a284ff-0f4c-48d6-b0e8-b35db079365a for instance a5112b52-9227-41cf-a36c-19e97dd4222c on hv-cinder-73761 Dec 02 15:54:23.071660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-281346f0-f11b-4846-afeb-89aee89ba3fc req-df60e727-a1ac-43b1-ac8a-9215a2495ef8 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.681684 Dec 02 15:54:23.074484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 383/726] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:54:22 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:54:23.162287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:23.164139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:23.164307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:23.191928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2153e1df-43bb-479a-be62-a1a8cb5834db tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1516 microversion: 2.1 time: 1.166613 Dec 02 15:54:23.202871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 344/727] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:22 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1516 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:23.205214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:23.206149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:23.207736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:23.211049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:23.420276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:23.421376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:23.437204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:23.438052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:23.438923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lazy-loading 'fault' on Instance uuid a5112b52-9227-41cf-a36c-19e97dd4222c {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:54:23.440517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:23.441416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:23.449580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:23.453103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:23.729189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:23.790796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:23.815008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:23.826200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-86e87185-af51-4994-a97b-9409a802922c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1373 microversion: 2.20 time: 0.740644 Dec 02 15:54:23.828722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 384/728] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:23 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1373 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:24.095856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:24.116945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6b4df582-e0b2-4bd8-89f8-4096a2ba43ef tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1608 microversion: 2.1 time: 0.716265 Dec 02 15:54:24.141001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 345/729] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:23 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1608 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:24.240581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:24.241327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:24.259385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:24.260374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:24.261927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:24.262850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.136880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-f9ada48e-6d4f-4bb7-ae7a-dede91ebc593 req-eb40416b-f766-4c96-a9ac-d5a301e32f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b113cf-44c3-41ee-abfd-329c10e9e8e7", "name": "network-vif-deleted", "tag": "6c5618f4-d019-4723-9ad0-1720cd93ca07"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:25.137522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:25.169134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d22e6d38-9667-427e-9a99-37fea69e6fd2 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1516 microversion: 2.1 time: 0.955851 Dec 02 15:54:25.180697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 385/730] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:24 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1516 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:25.180964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:54:25.180964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:54:25.195642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:25.196964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:25.229394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:25.230446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.232178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:25.234300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-f9ada48e-6d4f-4bb7-ae7a-dede91ebc593 req-eb40416b-f766-4c96-a9ac-d5a301e32f84 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:25.234817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-f9ada48e-6d4f-4bb7-ae7a-dede91ebc593 req-eb40416b-f766-4c96-a9ac-d5a301e32f84 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.241444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.271770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-f9ada48e-6d4f-4bb7-ae7a-dede91ebc593 req-eb40416b-f766-4c96-a9ac-d5a301e32f84 service nova] Creating event network-vif-deleted:6c5618f4-d019-4723-9ad0-1720cd93ca07 for instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 on hv-cinder-73761 Dec 02 15:54:25.290096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-f9ada48e-6d4f-4bb7-ae7a-dede91ebc593 req-eb40416b-f766-4c96-a9ac-d5a301e32f84 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.597388 Dec 02 15:54:25.294129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 346/731] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:54:24 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:54:25.307293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:25.308233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:25.322132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:25.322783 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.323784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:25.324387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.592679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:25.612454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:25.613276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:25.614230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lazy-loading 'fault' on Instance uuid a5112b52-9227-41cf-a36c-19e97dd4222c {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:54:25.619051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bebdc736-ced2-428d-9e35-16689aaea4dc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1608 microversion: 2.1 time: 0.323168 Dec 02 15:54:25.619699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 347/732] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:25 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1608 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:25.796351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:25.865403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:25.889709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:25.904329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2596d814-53b5-4f97-8989-ced9a1f53ce7 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 200 len: 1373 microversion: 2.20 time: 0.721135 Dec 02 15:54:25.904329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 386/733] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:25 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 1373 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:26.204035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:26.204722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:26.221916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:26.222713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:26.224935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:26.228675 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:26.652033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:26.652980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:26.685405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:26.691765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:26.698626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:26.699354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:26.818229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:26.842883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4fe42c27-3c63-4f93-91d6-a89c7370db1e tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1516 microversion: 2.1 time: 0.658134 Dec 02 15:54:26.844106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 348/734] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:26 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1516 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:26.914972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:26.923490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:26.924267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lazy-loading 'fault' on Instance uuid 86b113cf-44c3-41ee-abfd-329c10e9e8e7 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:54:26.948364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:26.953025 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:27.016537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:27.017658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:27.019241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:27.026401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:27.118858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:27.154743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9ad2d6fb-53ff-4318-8715-36559152af3d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 200 len: 1330 microversion: 2.1 time: 0.517058 Dec 02 15:54:27.164743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 387/735] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:26 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 1330 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:27.420261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] HTTP exception thrown: Instance a5112b52-9227-41cf-a36c-19e97dd4222c could not be found. Dec 02 15:54:27.421700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Returning 404 to user: Instance a5112b52-9227-41cf-a36c-19e97dd4222c could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:54:27.423636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d969b94d-2139-42b6-b965-4b0c1e1c2b8f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 404 len: 111 microversion: 2.20 time: 0.490748 Dec 02 15:54:27.439247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 349/736] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:26 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 111 bytes in 507 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 02 15:54:27.446045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5453becb-3957-4ce1-ae97-494942e821c5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '.version_select at 0x7f027064da60>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:27.573366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5453becb-3957-4ce1-ae97-494942e821c5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-8068724" status: 204 len: 0 microversion: 2.20 time: 0.137852 Dec 02 15:54:27.574311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 388/737] 10.222.0.101 () {60 vars in 1248 bytes} [Wed Dec 2 15:54:27 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-8068724 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 02 15:54:27.901039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:27.902087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:27.918055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:27.918935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:27.920555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:27.921473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:28.183953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:28.189301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:28.196782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:28.207240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6dc06987-397d-4cf0-883b-6b414eba2db5 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1474 microversion: 2.1 time: 0.328333 Dec 02 15:54:28.208377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 350/738] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:27 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:28.243848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:28.244556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:28.248074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:28.254047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:28.324639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] HTTP exception thrown: Instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 could not be found. Dec 02 15:54:28.325631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Returning 404 to user: Instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:54:28.327104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e050febb-3b7a-4675-98fd-3800f73d3344 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 404 len: 111 microversion: 2.1 time: 0.147726 Dec 02 15:54:28.328397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 389/739] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:28 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:54:28.353251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bcdcd38f-8eee-450e-a004-e28131cb99f5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '.version_select at 0x7f0263b092f0>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:28.436439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bcdcd38f-8eee-450e-a004-e28131cb99f5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-383944555" status: 202 len: 0 microversion: 2.1 time: 0.103061 Dec 02 15:54:28.443133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 351/740] 10.222.0.101 () {58 vars in 1213 bytes} [Wed Dec 2 15:54:28 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-383944555 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:54:28.974890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-3ed4c051-c855-4b14-857f-80fdc9c076cc req-91dba257-de85-4ac4-9c55-df9bb68bc324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c360ff-af0d-4210-a295-00447d5ed811", "name": "network-vif-deleted", "tag": "04beb8fe-6bf8-421f-a893-abffa9c2bb1d"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:28.992631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:54:28.992631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:54:29.011453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-3ed4c051-c855-4b14-857f-80fdc9c076cc req-91dba257-de85-4ac4-9c55-df9bb68bc324 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:29.012403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-3ed4c051-c855-4b14-857f-80fdc9c076cc req-91dba257-de85-4ac4-9c55-df9bb68bc324 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:29.055078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-3ed4c051-c855-4b14-857f-80fdc9c076cc req-91dba257-de85-4ac4-9c55-df9bb68bc324 service nova] Creating event network-vif-deleted:04beb8fe-6bf8-421f-a893-abffa9c2bb1d for instance 47c360ff-af0d-4210-a295-00447d5ed811 on hv-cinder-73761 Dec 02 15:54:29.063116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-3ed4c051-c855-4b14-857f-80fdc9c076cc req-91dba257-de85-4ac4-9c55-df9bb68bc324 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109430 Dec 02 15:54:29.064207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 390/741] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:54:28 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:54:29.234124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:29.243296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:29.271644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:29.280176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:29.281818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:29.282729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:29.728408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '361cc487f5a44c18b7c365738b6e4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '229596ae42204d5ead3f32ea7ab04bad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:29.761740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dd5bf088-3c4a-4230-bbad-d6d40c544328 tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 200 len: 1306 microversion: 2.1 time: 0.539107 Dec 02 15:54:29.762374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 352/742] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:29 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 1306 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:30.789217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:30.790768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] [instance: 47c360ff-af0d-4210-a295-00447d5ed811] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:30.805034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:30.812079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:30.813677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:30.814798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:30.963200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e4f01d76-bf98-46ba-b628-2bcf86f05884 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'create', calling method: .version_select at 0x7f027534f6a8>, body: {"keypair": {"name": "tempest-keypair-837807908"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:30.989114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] HTTP exception thrown: Instance 47c360ff-af0d-4210-a295-00447d5ed811 could not be found. Dec 02 15:54:30.989795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] Returning 404 to user: Instance 47c360ff-af0d-4210-a295-00447d5ed811 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:54:30.990709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c9263aa4-a4aa-47ff-b1f7-1d206aefce3b tempest-VolumesSnapshotTestJSON-887172574 tempest-VolumesSnapshotTestJSON-887172574] 10.222.0.101 "GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811" status: 404 len: 111 microversion: 2.1 time: 0.212615 Dec 02 15:54:30.991327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 391/743] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:30 2020] GET /compute/v2.1/servers/47c360ff-af0d-4210-a295-00447d5ed811 => generated 111 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:54:31.126840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-e4f01d76-bf98-46ba-b628-2bcf86f05884 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:31.142007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-e4f01d76-bf98-46ba-b628-2bcf86f05884 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for user 7231feb43e2144b890005197f88f34ba and project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:31.278096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-68d1cf04-ce42-406f-83af-9acbd02e8334 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: .version_select at 0x7f02710b0b70>, body: {"keypair": {"name": "tempest-keypair-1398129464"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:31.382199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-68d1cf04-ce42-406f-83af-9acbd02e8334 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:31.391214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-68d1cf04-ce42-406f-83af-9acbd02e8334 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for user 4b34c14f9d8a4a1d885f449b18e7bf5f and project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:31.707475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-68d1cf04-ce42-406f-83af-9acbd02e8334 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:31.713638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-68d1cf04-ce42-406f-83af-9acbd02e8334 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for user 4b34c14f9d8a4a1d885f449b18e7bf5f and project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:31.744499 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-68d1cf04-ce42-406f-83af-9acbd02e8334 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.476793 Dec 02 15:54:31.745691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 392/744] 10.222.0.101 () {60 vars in 1153 bytes} [Wed Dec 2 15:54:31 2020] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:31.765581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-e4f01d76-bf98-46ba-b628-2bcf86f05884 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:31.771677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-e4f01d76-bf98-46ba-b628-2bcf86f05884 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for user 7231feb43e2144b890005197f88f34ba and project db296e2b87e34627b69487c0870d6fb7. Resources: {'key_pairs'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:31.790000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e4f01d76-bf98-46ba-b628-2bcf86f05884 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.856380 Dec 02 15:54:31.790557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 353/745] 10.222.0.101 () {62 vars in 1194 bytes} [Wed Dec 2 15:54:30 2020] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 858 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 02 15:54:36.728985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8428a0f3-9e49-424e-a4ee-3060e8875f77 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: .version_select at 0x7f02710b0f28>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1001924322"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:36.743857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1873475556", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26c8fb3a-cf2f-41d8-b18f-a75a5ab07959"}], "security_groups": [{"name": "tempest-securitygroup--679066504"}], "key_name": "tempest-keypair-837807908", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:36.765331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-8428a0f3-9e49-424e-a4ee-3060e8875f77 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Getting quotas for project b3960161fdaa40adbf4ef023f92ffd5d. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:36.772883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-8428a0f3-9e49-424e-a4ee-3060e8875f77 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Getting quotas for user 821269dc140c4bffb56704768960364b and project b3960161fdaa40adbf4ef023f92ffd5d. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:36.894542 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] validate_networks() for [('26c8fb3a-cf2f-41d8-b18f-a75a5ab07959', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:54:37.183343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-8428a0f3-9e49-424e-a4ee-3060e8875f77 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Getting quotas for project b3960161fdaa40adbf4ef023f92ffd5d. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:37.188919 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-8428a0f3-9e49-424e-a4ee-3060e8875f77 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Getting quotas for user 821269dc140c4bffb56704768960364b and project b3960161fdaa40adbf4ef023f92ffd5d. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:37.228480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8428a0f3-9e49-424e-a4ee-3060e8875f77 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.515088 Dec 02 15:54:37.234541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 393/746] 10.222.0.101 () {60 vars in 1153 bytes} [Wed Dec 2 15:54:36 2020] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:37.251026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-115251744", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92487b79-3b7b-42f3-8b9b-942f6ba445e1"}], "security_groups": [{"name": "tempest-securitygroup--1550291364"}], "key_name": "tempest-keypair-1398129464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:37.498339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] validate_networks() for [('92487b79-3b7b-42f3-8b9b-942f6ba445e1', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:54:37.998534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:54:37.999525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:54:38.000222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:54:38.000813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:54:38.001455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:54:38.013699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:38.014439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:38.015328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:38.015928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:38.040471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for project db296e2b87e34627b69487c0870d6fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:38.045596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Getting quotas for user 7231feb43e2144b890005197f88f34ba and project db296e2b87e34627b69487c0870d6fb7. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:38.058950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:54:38.061729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:54:38.205536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-44496b3f-8e33-4573-b0e7-9daee940afae tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 1.472625 Dec 02 15:54:38.206518 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 354/747] 10.222.0.101 () {62 vars in 1183 bytes} [Wed Dec 2 15:54:36 2020] POST /compute/v2.1/servers => generated 403 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 02 15:54:38.222060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-939204492", "imageRef": "b2216f96-31f7-4669-b555-c62906a63030", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1001924322", "networks": [{"uuid": "08fcbd27-70ce-4049-b75e-7a1e77449ef3"}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:38.379397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] validate_networks() for [('08fcbd27-70ce-4049-b75e-7a1e77449ef3', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:54:38.558216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:54:38.558699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:54:38.559256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:54:38.559713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:54:38.565706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:54:38.582110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:38.584042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:38.586258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:38.587616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:38.656075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:38.664227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Getting quotas for user 4b34c14f9d8a4a1d885f449b18e7bf5f and project 8bd15c18c1994d418ad257735d95e8d5. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:38.708633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:54:38.727833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:54:38.960065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-40ff3816-e9a1-4c5c-bd9d-f2c0cd9a0824 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.728685 Dec 02 15:54:38.961910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 394/748] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:54:37 2020] POST /compute/v2.1/servers => generated 404 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:54:38.974089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f9b72f30-b715-4c98-9efa-f583cf110a71 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:38.975680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f9b72f30-b715-4c98-9efa-f583cf110a71 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:39.197388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f9b72f30-b715-4c98-9efa-f583cf110a71 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:39.217210 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f9b72f30-b715-4c98-9efa-f583cf110a71 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:39.227643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f9b72f30-b715-4c98-9efa-f583cf110a71 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:39.229248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f9b72f30-b715-4c98-9efa-f583cf110a71 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1285 microversion: 2.20 time: 0.266495 Dec 02 15:54:39.230028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 395/749] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:38 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1285 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:39.249707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f38ed4dd-8bdc-4c02-8d73-d60b78fb3d43 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:39.250861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f38ed4dd-8bdc-4c02-8d73-d60b78fb3d43 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:39.344221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f38ed4dd-8bdc-4c02-8d73-d60b78fb3d43 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:39.354253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f38ed4dd-8bdc-4c02-8d73-d60b78fb3d43 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1241 microversion: 2.1 time: 0.122811 Dec 02 15:54:39.355176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 396/750] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:39 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:39.467513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:54:39.468741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:54:39.469824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:54:39.470685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:54:39.471384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:54:39.485857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:39.486618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:39.487759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:39.488240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:39.510419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Getting quotas for project b3960161fdaa40adbf4ef023f92ffd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:54:39.515203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Getting quotas for user 821269dc140c4bffb56704768960364b and project b3960161fdaa40adbf4ef023f92ffd5d. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:54:39.536600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:54:39.543790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2216f96-31f7-4669-b555-c62906a63030',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:54:39.637769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0d0b6a92-d0f5-4d4a-8772-83497ca81450 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.429399 Dec 02 15:54:39.638976 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 355/751] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:54:38 2020] POST /compute/v2.1/servers => generated 382 bytes in 1432 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:54:39.668693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d06a0d82-5505-4b01-aa6c-1eb8062b1247 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:39.670334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d06a0d82-5505-4b01-aa6c-1eb8062b1247 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:39.814929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d06a0d82-5505-4b01-aa6c-1eb8062b1247 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:39.838787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d06a0d82-5505-4b01-aa6c-1eb8062b1247 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1262 microversion: 2.1 time: 0.188172 Dec 02 15:54:39.839535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 397/752] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:39 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1262 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:40.281394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:40.282805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:40.293707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:40.294286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:40.295586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:40.296100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:40.378859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:40.379479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:40.388310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:40.388830 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:40.389685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:40.390180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:40.488872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:40.530157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:40.548808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:40.552530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9b9cab79-2b3a-485a-9ced-5744af5a08cd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1337 microversion: 2.20 time: 0.291711 Dec 02 15:54:40.555826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 356/753] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:40 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1337 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:40.598676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:40.613800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2a712ac9-a9bd-45df-93b0-e2e454e8b440 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1245 microversion: 2.1 time: 0.244403 Dec 02 15:54:40.625032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 398/754] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:40 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1245 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:54:40.869151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:40.870774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:40.886896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:40.888020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:40.889505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:40.890731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:41.083021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:41.102942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0133fb3e-506a-49f8-b0d0-7e30851ba7ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1266 microversion: 2.1 time: 0.246337 Dec 02 15:54:41.108865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 357/755] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:40 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:41.583737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:41.584406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:41.594123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:41.594635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:41.595494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:41.596021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:41.640264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:41.642138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:41.651320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:41.652258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:41.653328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:41.654043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:41.880066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:41.904817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:41.914009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:41.915044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-34562d4f-a51a-4ba0-a8e7-b51e8cf71f39 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1343 microversion: 2.20 time: 0.342077 Dec 02 15:54:41.915902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 399/756] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:41 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1343 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:42.016183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:42.036708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d4a49197-3a1c-43b4-8a63-7a14752e1c82 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1293 microversion: 2.1 time: 0.403976 Dec 02 15:54:42.042515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 358/757] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:41 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1293 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:42.140870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:42.141749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:42.159995 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:42.161100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:42.161995 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:42.162483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:42.653150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:42.666579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6a7d82da-97e5-42f7-a1a2-8cae81fb02d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1314 microversion: 2.1 time: 0.539217 Dec 02 15:54:42.667342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 400/758] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:42 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:42.972348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:42.976589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:42.998768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:42.999550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:43.009207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:43.011727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:43.072232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:43.073969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:43.085624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:43.086303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:43.087319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:43.088047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:43.367076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:43.379354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fd3aea4e-8fe3-463b-94a0-59ebe430dcad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1299 microversion: 2.1 time: 0.320122 Dec 02 15:54:43.380737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 401/759] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:43 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:43.697262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:43.698562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:43.714172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:43.724904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:43.728249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:43.729152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:43.729654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:43.731851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:43.740224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:43.741672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-02b6326e-15a9-4596-96d8-d514088eaca5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.807516 Dec 02 15:54:43.742759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 359/760] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:42 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:54:44.120708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:44.144556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-98e4fe9d-74ff-40c8-93c0-8744f721385c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1320 microversion: 2.1 time: 0.463129 Dec 02 15:54:44.159331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 402/761] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:43 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:44.435371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:44.444988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:44.482781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:44.494550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:44.496303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:44.496826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:44.767202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:44.767790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:44.789737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:44.790559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:44.791614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:44.800763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:44.969387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:44.989233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5bbc6f9f-8100-442c-b33f-20bb42106c55 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1299 microversion: 2.1 time: 0.590137 Dec 02 15:54:44.997100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 360/762] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:44 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1299 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:45.182295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:45.184047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:45.216916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:45.218523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:45.220731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:45.229275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:45.777909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:45.806268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:45.820962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:45.826096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1e0708ec-ada0-4898-9a86-2fbc91f26305 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 1.068523 Dec 02 15:54:45.827015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 403/763] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:44 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:45.982247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:46.028140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b004f7c0-f760-4e52-b346-856aa6ae7360 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1320 microversion: 2.1 time: 0.864458 Dec 02 15:54:46.033724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:46.039181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 361/764] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:45 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1320 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:54:46.040327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:46.068654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:46.069560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:46.070646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:46.071334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:46.450377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ed55f12c-c2d3-408a-bfc1-09567e4f7800 req-6edc0e93-b565-428d-84bb-397e1b0e95b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca", "tag": "8520bf21-16f0-4a79-b561-5531577e5d0c"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:54:46.471767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:54:46.471767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:54:46.490331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ed55f12c-c2d3-408a-bfc1-09567e4f7800 req-6edc0e93-b565-428d-84bb-397e1b0e95b4 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:46.490731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ed55f12c-c2d3-408a-bfc1-09567e4f7800 req-6edc0e93-b565-428d-84bb-397e1b0e95b4 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:46.547224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:46.550234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ed55f12c-c2d3-408a-bfc1-09567e4f7800 req-6edc0e93-b565-428d-84bb-397e1b0e95b4 service nova] Creating event network-changed:8520bf21-16f0-4a79-b561-5531577e5d0c for instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca on hv-cinder-73761 Dec 02 15:54:46.557800 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ed55f12c-c2d3-408a-bfc1-09567e4f7800 req-6edc0e93-b565-428d-84bb-397e1b0e95b4 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146643 Dec 02 15:54:46.558947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 362/765] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:54:46 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:54:46.565939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-943c77c6-c082-47eb-b739-41ef0bdd9468 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.541892 Dec 02 15:54:46.569006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 404/766] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:46 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:46.862490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:46.863318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:46.876853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:46.877680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:46.879927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:46.881030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:47.108578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:47.116707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:47.153239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:47.154471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:47.156015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:47.156737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:47.509283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:47.541457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:47.550531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:47.552013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c8a355cf-e112-4f9d-b6f3-883f635eeba8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.700575 Dec 02 15:54:47.553307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 363/767] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:46 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:47.608054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:47.609130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:47.619652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:47.624966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:47.627222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:47.635753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:47.817689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:47.838305 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-85e3c677-583e-4efb-9c31-786cdf8ea280 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.793800 Dec 02 15:54:47.852032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 405/768] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:47 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:48.022404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:48.032167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f6767c13-aeeb-4e90-8048-0d8fea27a754 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.435702 Dec 02 15:54:48.032851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 364/769] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:47 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:54:48.594144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:48.594826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:48.612463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:48.612463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:48.612463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:48.612463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:48.875719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:48.876985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:48.888275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:48.889179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:48.890345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:48.891060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:48.960351 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:48.994994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:49.037392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:49.040775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f4514d14-2577-4f11-b3ad-c311cc3ad29a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.458240 Dec 02 15:54:49.042174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 406/770] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:48 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:49.109353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:49.110684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:49.148535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:49.155382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:49.157045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:49.157949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:49.336311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:49.354616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-851d151f-4ec6-4e3b-9502-ee90c5002dd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.489315 Dec 02 15:54:49.355560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 365/771] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:48 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:54:49.601880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:49.612740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-49f5351d-e089-4eb0-b589-389b4d5ac88a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.548546 Dec 02 15:54:49.613411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 407/772] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:49 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:50.109022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:50.109022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:50.120649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:50.124876 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:50.126153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:50.126869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:50.393631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:50.394312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:50.443885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:50.445720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:50.448583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:50.450321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:50.644835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:50.690325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:50.710934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:50.712953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-98960e05-6735-46dc-b5ab-85b8bc717e67 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.641254 Dec 02 15:54:50.714303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 366/773] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:50 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:50.737932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:50.738978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:50.752784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:50.753671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:50.756823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:50.757756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:50.848432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:50.860384 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-09792140-816e-4a75-8954-9f171952e993 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.483339 Dec 02 15:54:50.861328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 408/774] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:50 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:54:51.167314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:51.193411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-791ae63e-841b-4f11-b41b-c2bc5694a127 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.475063 Dec 02 15:54:51.194558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 367/775] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:50 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:51.746771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:51.748425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:51.773139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:51.774008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:51.785833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:51.786582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:51.890339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:51.896998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:51.923109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:51.924400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:51.925329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:51.926726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:52.559739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:52.561067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:52.602194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-75d225f2-57ee-42b6-8424-5c776c592adb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.723289 Dec 02 15:54:52.604857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 368/776] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:51 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:52.628400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:52.631854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:52.641457 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:52.650825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:52.651835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:52.653392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:52.654289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:52.667137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:52.668460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-83412265-4823-458f-adcd-4d048fd4b8bf tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.938341 Dec 02 15:54:52.669368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 409/777] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:51 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:53.132849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:53.169454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d345ff9a-6903-460d-98df-c42dab9eb524 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.562335 Dec 02 15:54:53.170470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 369/778] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:52 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:53.668738 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:53.670863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:53.686042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:53.687492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:53.689235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:53.690694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:53.732900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:53.734076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:53.778215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:53.779108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:53.780633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:53.781488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:54.437359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:54.470012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c2a5fed9-94f5-4732-a7ac-3b1e85a7d6ac tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.835556 Dec 02 15:54:54.472161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 410/779] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:53 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:54.514542 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:54.515813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:54.536458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:54.537714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:54.539311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:54.540266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:54.678560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:54.711445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:54.727085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:54.732338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e24ab2b-0781-4398-b097-df014eac01d4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 1.027486 Dec 02 15:54:54.732338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 370/780] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:53 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:54.962971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:55.003162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3d9bf563-f99b-4899-b344-ad933c1f49ff tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.525923 Dec 02 15:54:55.005611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 411/781] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:54 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:55.531568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:55.532988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:55.548684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:55.549572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:55.552320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:55.553173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:55.768236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:55.769268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:55.778470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:55.779183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:55.780085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:55.780771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:56.073288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:56.116244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fe6a7da9-d414-41fb-ac91-ccea04a78b17 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.612296 Dec 02 15:54:56.132023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 371/782] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:55 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:56.144445 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:56.145519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:56.154434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:56.154912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:56.156005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:56.156746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:56.184415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:56.201224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:56.208633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:56.210277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1f3d45da-9a64-4bd6-9bcc-ea155f7fa563 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.453068 Dec 02 15:54:56.211182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 412/783] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:55 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:54:56.461225 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:56.472100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-034f4dc1-4215-4f65-88ff-205cff46f4d4 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.342996 Dec 02 15:54:56.473605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 372/784] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:56 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:57.153718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:57.155004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:57.165131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07aa14a9-9e13-4c27-a494-8bf09fb36391] AMQP server on 10.222.0.101:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 02 15:54:57.166743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:57.167611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:57.168798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:57.169641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:57.247938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:57.249396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:57.265573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:57.266338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:57.267329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:57.267936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:57.684340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:57.703267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-63c67c48-02b3-4d2b-9310-02db8997e8d8 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.561152 Dec 02 15:54:57.720478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 413/785] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:57 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:54:57.720478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:57.720478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:57.740867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:57.741737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:57.742801 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:57.743458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:57.904216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:57.951864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:57.973070 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:57.976620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a249f864-eaf7-471b-a24b-22712cc6aaee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.748701 Dec 02 15:54:57.977882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 373/786] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:57 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:54:58.189083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] [07aa14a9-9e13-4c27-a494-8bf09fb36391] Reconnected to AMQP server on 10.222.0.101:5672 via [amqp] client with port 43368. Dec 02 15:54:58.536925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:58.553820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7dd824b2-f64b-42dd-bc4a-cd4f6ee72f03 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.848406 Dec 02 15:54:58.556316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 414/787] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:57 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:54:58.740748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:58.741807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:58.753943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:58.755541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:58.756764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:58.757481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:59.017784 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:59.018789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:59.040466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:59.041136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:59.042786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:59.044051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:59.572653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:59.619606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:59.640913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:59.643913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af049752-3e52-4a2a-84c2-7d3e52fb48d5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.637212 Dec 02 15:54:59.645951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 415/788] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:54:59 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:54:59.694196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:54:59.695371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:54:59.714480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:59.715075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:59.716560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:54:59.717421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:54:59.793667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:54:59.804687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fd8bea95-28a5-442a-bffd-711d8b657a0c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 1.074801 Dec 02 15:54:59.815856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 374/789] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:58 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:00.143252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:00.166241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a2562694-848c-4022-98aa-d701e24765d7 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.496316 Dec 02 15:55:00.167600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 416/790] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:54:59 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:00.700077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:00.700694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-e57e3285-7f61-4a1a-8ab5-58546855eb70 req-e8357089-1dd6-4ad4-a850-8dad3a88f1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:00.701794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:00.710503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:00.710503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:00.711721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:00.712720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:00.713839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:00.714514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:00.729162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e57e3285-7f61-4a1a-8ab5-58546855eb70 req-e8357089-1dd6-4ad4-a850-8dad3a88f1c1 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:00.730149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e57e3285-7f61-4a1a-8ab5-58546855eb70 req-e8357089-1dd6-4ad4-a850-8dad3a88f1c1 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:00.826912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-e57e3285-7f61-4a1a-8ab5-58546855eb70 req-e8357089-1dd6-4ad4-a850-8dad3a88f1c1 service nova] Creating event network-changed:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:55:00.837879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-e57e3285-7f61-4a1a-8ab5-58546855eb70 req-e8357089-1dd6-4ad4-a850-8dad3a88f1c1 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171383 Dec 02 15:55:00.838550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 375/791] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:00 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:00.856677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:00.857469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:00.898251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:00.898759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:00.899633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:00.900162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:01.152498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:01.171007 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:01.178643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:01.179948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-88ce8b89-7494-46fc-bd17-75b5d26f76d8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.505155 Dec 02 15:55:01.180584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 417/792] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:55:00 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:55:01.204836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:01.205520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:01.215062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:01.215681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:01.216685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:01.217194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:01.543607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:01.558533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e1a44102-fec5-400b-b07d-38c1c6b4459e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.363010 Dec 02 15:55:01.560032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 418/793] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:01 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:01.678730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-f16f98ee-e3f8-4deb-b8ab-9f475ad8894b req-1129e99a-3027-4b68-a088-035c1b66e7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca", "name": "network-vif-plugged", "status": "completed", "tag": "8520bf21-16f0-4a79-b561-5531577e5d0c"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:01.687452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:01.687452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:01.699099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-f16f98ee-e3f8-4deb-b8ab-9f475ad8894b req-1129e99a-3027-4b68-a088-035c1b66e7c3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:01.699719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-f16f98ee-e3f8-4deb-b8ab-9f475ad8894b req-1129e99a-3027-4b68-a088-035c1b66e7c3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:01.721770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-f16f98ee-e3f8-4deb-b8ab-9f475ad8894b req-1129e99a-3027-4b68-a088-035c1b66e7c3 service nova] Creating event network-vif-plugged:8520bf21-16f0-4a79-b561-5531577e5d0c for instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca on hv-cinder-73761 Dec 02 15:55:01.736250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-f16f98ee-e3f8-4deb-b8ab-9f475ad8894b req-1129e99a-3027-4b68-a088-035c1b66e7c3 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069080 Dec 02 15:55:01.736250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 419/794] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:01 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:55:02.224168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:02.225271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:02.247524 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:02.249104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:02.251754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:02.253546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:02.362274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:02.373380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cfcccd1a-202a-4bf6-8a9d-b0d6cdeb3bc9 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 1.533160 Dec 02 15:55:02.373993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 376/795] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:00 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:02.566552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:02.585217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:02.585914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:02.586460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:02.594676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:02.595020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:02.595418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:02.595899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-abc281a3-23b9-49e9-9b0f-60680581d5a5 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1410 microversion: 2.20 time: 0.397905 Dec 02 15:55:02.596353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:02.596557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 420/796] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:55:02 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1410 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:55:02.596853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:02.915362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-173c3c56-1a21-4f7f-8f93-435e39e9ed28 req-be81315f-a165-4627-b37a-578adadfc25d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f6bca3-ecd8-46bf-b78b-11c4e89fdb61", "tag": "3e83b8a1-a2d7-4b77-ba2c-33336ed53c88"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:02.924045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:02.924045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:02.935464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-173c3c56-1a21-4f7f-8f93-435e39e9ed28 req-be81315f-a165-4627-b37a-578adadfc25d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:02.935958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-173c3c56-1a21-4f7f-8f93-435e39e9ed28 req-be81315f-a165-4627-b37a-578adadfc25d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:02.957576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-173c3c56-1a21-4f7f-8f93-435e39e9ed28 req-be81315f-a165-4627-b37a-578adadfc25d service nova] Creating event network-changed:3e83b8a1-a2d7-4b77-ba2c-33336ed53c88 for instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 on hv-cinder-73761 Dec 02 15:55:02.963257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-173c3c56-1a21-4f7f-8f93-435e39e9ed28 req-be81315f-a165-4627-b37a-578adadfc25d service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062075 Dec 02 15:55:02.964106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 421/797] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:02 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:55:03.410008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:03.411162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:03.421567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:03.422145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:03.423062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:03.423737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:03.868565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:03.881398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e945644d-c843-40af-95b3-8fe74e768dd8 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 1.307417 Dec 02 15:55:03.882298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 377/798] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:02 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:03.899766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:03.900965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:03.911212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:03.911861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:03.912804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:03.913297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:04.164861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:04.194129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-88319219-b9d7-47ac-8616-3aa6e549938f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.795203 Dec 02 15:55:04.195324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 422/799] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:03 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:04.544048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:04.578641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:04.587941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:04.589604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-49b1c152-6556-4eb9-99c1-8b72c2b98123 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1602 microversion: 2.20 time: 0.704654 Dec 02 15:55:04.591044 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 378/800] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:55:03 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1602 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:55:04.632018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:04.633053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:04.645636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:04.646298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:04.647521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:04.648313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:04.923341 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:04.924617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:04.935673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:04.936668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:04.937944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:04.938884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:05.528430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7e87199a-cbb2-4a00-b037-ac63ec7ff729 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.909659 Dec 02 15:55:05.530012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 423/801] 10.222.0.101 () {60 vars in 1311 bytes} [Wed Dec 2 15:55:04 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/os-interface => generated 284 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:05.543430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:05.544849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:05.555468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:05.556406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:05.557870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:05.558654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:06.302344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:06.324271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-503bc8d3-7435-4dd6-92c2-f695c4b51786 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 1.411996 Dec 02 15:55:06.325424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 379/802] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:04 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:06.860396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:06.889662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6574c7b7-bef3-4a65-a455-1a5122bcede5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 1.357828 Dec 02 15:55:06.895721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 424/803] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:05 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:07.357300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:07.357904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:07.367681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:07.368224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:07.369104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:07.369593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:07.639572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:07.657779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9ea7afd7-4e68-45aa-b959-1cf65763a7af tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.309698 Dec 02 15:55:07.658752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 380/804] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:07 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:07.927605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:07.928650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:07.937526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:07.938123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:07.938973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:07.939718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:08.615028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:08.636712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-291aa578-56d7-40b6-9cd1-ddfb9be8cb2f tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.719650 Dec 02 15:55:08.638106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 425/805] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:07 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:08.716157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:08.717577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:08.735129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:08.736584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:08.739301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:08.740839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:08.903769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-91a48466-e0e3-49dc-93c1-790f3e0b4a9a req-b0041379-27d6-408e-b1f7-a2124e709c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "name": "network-vif-plugged", "status": "completed", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:08.914268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:08.914268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:08.927488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-91a48466-e0e3-49dc-93c1-790f3e0b4a9a req-b0041379-27d6-408e-b1f7-a2124e709c8f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:08.928941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-91a48466-e0e3-49dc-93c1-790f3e0b4a9a req-b0041379-27d6-408e-b1f7-a2124e709c8f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:08.951203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-91a48466-e0e3-49dc-93c1-790f3e0b4a9a req-b0041379-27d6-408e-b1f7-a2124e709c8f service nova] Creating event network-vif-plugged:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:55:08.960414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-91a48466-e0e3-49dc-93c1-790f3e0b4a9a req-b0041379-27d6-408e-b1f7-a2124e709c8f service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066744 Dec 02 15:55:08.961420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 426/806] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:08 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:09.215260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:09.236240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-305e9f23-5747-4de7-a3f8-3ddbfed59542 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.551391 Dec 02 15:55:09.238788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 381/807] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:08 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:09.512366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:09.514050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-3f598799-ae54-425e-a4f1-e7a5d99eda61 req-2238eee6-294f-47d7-a51b-2f85ddb66403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca", "tag": "8520bf21-16f0-4a79-b561-5531577e5d0c"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:09.514535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:09.523880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:09.523880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:09.532635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:09.533629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:09.535857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:09.536837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:09.539333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-3f598799-ae54-425e-a4f1-e7a5d99eda61 req-2238eee6-294f-47d7-a51b-2f85ddb66403 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:09.540104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-3f598799-ae54-425e-a4f1-e7a5d99eda61 req-2238eee6-294f-47d7-a51b-2f85ddb66403 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:09.563788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-3f598799-ae54-425e-a4f1-e7a5d99eda61 req-2238eee6-294f-47d7-a51b-2f85ddb66403 service nova] Creating event network-changed:8520bf21-16f0-4a79-b561-5531577e5d0c for instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca on hv-cinder-73761 Dec 02 15:55:09.571077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-3f598799-ae54-425e-a4f1-e7a5d99eda61 req-2238eee6-294f-47d7-a51b-2f85ddb66403 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076394 Dec 02 15:55:09.572501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 382/808] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:09 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:09.676786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:09.684794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:09.707562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:09.708570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:09.710236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:09.711148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:09.763621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-254a9382-ab6b-44d9-a8f7-81abd7d700ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 14 microversion: 2.20 time: 0.293449 Dec 02 15:55:09.765962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 427/809] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:09 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 14 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:10.274062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:10.307616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:10.310877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b7c02e91-33c6-4d6e-a83b-5c2f4bbbe874 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1362 microversion: 2.1 time: 0.644484 Dec 02 15:55:10.311537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 383/810] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:09 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:10.316616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:10.336689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:10.337874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:10.339483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:10.340888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:10.761388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:10.783947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f7a7880b-f2d3-4a6a-8df2-3487abd6efc5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.518305 Dec 02 15:55:10.786359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:10.786608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 428/811] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:10 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:10.787758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:10.806954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:10.807599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:10.808576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:10.809236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:11.029936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-aa9eae5a-179a-4740-9748-366d62adce97 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 14 microversion: 2.20 time: 0.254895 Dec 02 15:55:11.031039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 384/812] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:10 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 14 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:11.130770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-e8471fc8-d42d-4ab5-8ef9-1cb40b8dc7cb req-32e0e956-c3e5-43fe-9b61-fb87f7224299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f6bca3-ecd8-46bf-b78b-11c4e89fdb61", "name": "network-vif-plugged", "status": "completed", "tag": "3e83b8a1-a2d7-4b77-ba2c-33336ed53c88"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:11.157809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:11.157809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:11.210695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e8471fc8-d42d-4ab5-8ef9-1cb40b8dc7cb req-32e0e956-c3e5-43fe-9b61-fb87f7224299 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:11.213021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e8471fc8-d42d-4ab5-8ef9-1cb40b8dc7cb req-32e0e956-c3e5-43fe-9b61-fb87f7224299 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:11.262715 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-e8471fc8-d42d-4ab5-8ef9-1cb40b8dc7cb req-32e0e956-c3e5-43fe-9b61-fb87f7224299 service nova] Creating event network-vif-plugged:3e83b8a1-a2d7-4b77-ba2c-33336ed53c88 for instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 on hv-cinder-73761 Dec 02 15:55:11.275473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-e8471fc8-d42d-4ab5-8ef9-1cb40b8dc7cb req-32e0e956-c3e5-43fe-9b61-fb87f7224299 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158543 Dec 02 15:55:11.278638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 429/813] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:11 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:55:11.361742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:11.363198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:11.394906 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:11.397462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:11.400368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:11.402368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:11.834332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:11.837356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:11.863583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:11.864700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:11.866349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:11.867265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:12.235338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:12.254722 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-936d3c40-18a6-414b-88bb-9822f535f3f4 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1552 microversion: 2.1 time: 0.916038 Dec 02 15:55:12.258539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 385/814] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:11 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1552 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:12.290754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:12.296328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:12.313878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:12.317180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:12.318553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:12.324880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:12.492177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:12.517746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0637040f-1d4c-4522-8e74-10f84da8b7ee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.697784 Dec 02 15:55:12.524570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 430/815] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:11 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:12.548844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e227c453-7222-4b72-962c-24d3512d5a14 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 14 microversion: 2.20 time: 0.287421 Dec 02 15:55:12.549561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 386/816] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:12 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 14 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:12.553030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:12.553718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:12.563528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:12.564216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:12.566264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:12.566587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:12.931480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:12.960944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6ba5cc27-6502-45c4-b4cf-5857f26c039b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1552 microversion: 2.1 time: 0.433451 Dec 02 15:55:12.962744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 431/817] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:12 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1552 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:13.012876 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:13.048199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:13.048199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:13.052040 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:13.053672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Searching by: {'deleted': False, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d'} {{(pid=94391) get_all /opt/stack/nova/nova/compute/api.py:2829}} Dec 02 15:55:13.067728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.068682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.070411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.071246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.253954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.multi_cell_list [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=94391) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Dec 02 15:55:13.366724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c7f010c7-297c-4598-88e9-66dbdbb547b6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.378690 Dec 02 15:55:13.368291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 387/818] 10.222.0.101 () {58 vars in 1120 bytes} [Wed Dec 2 15:55:12 2020] GET /compute/v2.1/servers => generated 344 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:13.386521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:13.387187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:13.397540 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.398216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.399249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.400042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.564863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:13.566415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:13.586977 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.588260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.589569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.590453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.792035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:13.801687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1b327466-0b1f-4e24-bd38-3a56e8c42509 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1552 microversion: 2.1 time: 0.425684 Dec 02 15:55:13.807615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 432/819] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:13 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1552 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:13.813525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:13.814241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:13.825890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.826217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:13.827117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:13.827838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:14.064890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-313914eb-cbb1-46c5-b52a-cffe9faf8847 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 14 microversion: 2.20 time: 0.261101 Dec 02 15:55:14.069145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 433/820] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:13 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 14 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:14.209947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:14.223912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6adf077f-5092-40e3-9081-5531857cae1f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1367 microversion: 2.1 time: 0.679236 Dec 02 15:55:14.224726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 388/821] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:13 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1367 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:15.114174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:15.122684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:15.169199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:15.170472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:15.173534 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:15.185262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:15.260897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:15.261587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:15.286676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:15.288945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:15.290858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:15.292054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:15.438184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-51aa8a5b-1043-4cc2-9e52-27939576004e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 14 microversion: 2.20 time: 0.362200 Dec 02 15:55:15.439388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 434/822] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:15 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 14 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:15.794799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:15.804769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-26896a64-983e-41cf-b999-87dccb3d8c52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1552 microversion: 2.1 time: 0.554757 Dec 02 15:55:15.805394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 389/823] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:15 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1552 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:15.829615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:15.830271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:15.840824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:15.846924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:15.846924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:15.846924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:16.150198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c2c4fce-b41d-4b7d-9906-9c21afbf5bb9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.330460 Dec 02 15:55:16.152511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 435/824] 10.222.0.101 () {58 vars in 1270 bytes} [Wed Dec 2 15:55:15 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:16.463741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:16.466172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:16.485474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:16.486904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:16.489599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:16.490764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:16.586448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:16.589055 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:16.599551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:16.600488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:16.601555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:16.602249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:16.733677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3b21cd5e-74e4-4557-9364-3ebbd3be6987 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 4579 microversion: 2.20 time: 0.282277 Dec 02 15:55:16.735093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 390/825] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:16 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 4579 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:55:17.570249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e354a682-4b08-4d56-aa8f-d5b8ef6fea80 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.998099 Dec 02 15:55:17.571711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 436/826] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:55:16 2020] POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/os-volume_attachments => generated 194 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:17.757496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:17.770911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:17.787014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:17.787626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:17.788560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:17.789350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:18.008088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f045553a-994c-4b36-a1c2-9f2cb1e968fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 15025 microversion: 2.20 time: 0.262984 Dec 02 15:55:18.012650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 391/827] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:17 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 15025 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:18.926928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-99f672d8-90da-4301-af0e-791c09a5d1b2 req-517039c5-5012-4104-99d7-1ecc2862232a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f6bca3-ecd8-46bf-b78b-11c4e89fdb61", "tag": "3e83b8a1-a2d7-4b77-ba2c-33336ed53c88"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:18.929215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:18.935497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:18.949670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:18.949670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:18.984152 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-99f672d8-90da-4301-af0e-791c09a5d1b2 req-517039c5-5012-4104-99d7-1ecc2862232a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:18.985774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:18.989199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:18.990572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:18.992942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:18.996933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-99f672d8-90da-4301-af0e-791c09a5d1b2 req-517039c5-5012-4104-99d7-1ecc2862232a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:19.032284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-99f672d8-90da-4301-af0e-791c09a5d1b2 req-517039c5-5012-4104-99d7-1ecc2862232a service nova] Creating event network-changed:3e83b8a1-a2d7-4b77-ba2c-33336ed53c88 for instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 on hv-cinder-73761 Dec 02 15:55:19.040043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-99f672d8-90da-4301-af0e-791c09a5d1b2 req-517039c5-5012-4104-99d7-1ecc2862232a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140323 Dec 02 15:55:19.041903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 392/828] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:18 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:19.060567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:19.062375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:19.074786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:19.075736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:19.076899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:19.077633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:19.307413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8abab6c8-e015-4386-95d7-643d5ff209dd tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.412963 Dec 02 15:55:19.310092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 437/829] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:18 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:19.346653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8aa657e1-33f3-47c0-80c2-09646b72133f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 18208 microversion: 2.20 time: 0.301455 Dec 02 15:55:19.347991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 393/830] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:19 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 18208 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:20.342543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:20.346043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:20.372446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:20.373631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:20.375820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:20.376529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:20.377321 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:20.378331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:20.406918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:20.407427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:20.408379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:20.410299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:20.610323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f1c6714c-635d-48d7-9682-38be8fd773c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 19342 microversion: 2.20 time: 0.251876 Dec 02 15:55:20.611312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 394/831] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:20 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 19342 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:55:20.638744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fde73afa-4143-4f05-b142-e8e00426e8c6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.318002 Dec 02 15:55:20.645600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 438/832] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:20 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:21.636757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:21.640650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:21.662468 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:21.669306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:21.672610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:21.673596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:21.674985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:21.678001 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:21.691508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:21.692150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:21.698085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:21.698676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:21.890255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2bf8e2e4-1959-4a87-a751-fd3ea2338ea0 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.239926 Dec 02 15:55:21.892371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 439/833] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:21 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:21.934170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-25fa483d-08ff-43fb-9cc0-e441268882e0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 22716 microversion: 2.20 time: 0.312247 Dec 02 15:55:21.935849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 395/834] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:21 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 22716 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:22.910456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:22.911585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:22.921318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:22.921812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:22.922891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:22.923581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:22.959421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:22.969565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:22.986851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:22.987560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:22.988844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:22.989370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:23.120508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ae636945-079f-4d29-bd88-7dff8ec8e408 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.220379 Dec 02 15:55:23.124294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 440/835] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:22 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:23.239629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5308c745-4729-41fc-a528-32d4d0e8907b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 23924 microversion: 2.20 time: 0.294991 Dec 02 15:55:23.241308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 396/836] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:22 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 23924 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:55:24.173650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:24.177416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:24.194717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:24.195386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:24.197120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:24.198610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:24.273766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:24.276638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:24.295667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:24.297143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:24.299885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:24.301303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:24.437563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4084cb2f-3234-4351-a8fa-4cd3c4da856b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.305184 Dec 02 15:55:24.438610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 441/837] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:24 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:24.527753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5ab6671b-a7e6-4658-82c7-e6ec7675db3e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 25317 microversion: 2.20 time: 0.278016 Dec 02 15:55:24.530504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 397/838] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:24 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 25317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:25.493272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:25.496840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:25.518584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:25.518584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:25.520308 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:25.520632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:25.566355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:25.573202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:25.605630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:25.606331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:25.607336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:25.612746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:25.900760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-db33d6cd-8419-48a7-b1ad-fed8996c105d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.449110 Dec 02 15:55:25.904443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 442/839] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:25 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:25.955809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b37a68f1-9790-4082-868c-bf18a1e10bcc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 26734 microversion: 2.20 time: 0.410818 Dec 02 15:55:25.955809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 398/840] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:25 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 26734 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:26.622099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:26.623484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:26.633887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:26.634623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:26.635848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:26.636703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:26.933714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:26.936529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:26.959184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:26.963897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:26.970580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:26.972212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:27.269563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2260a31d-beb5-4494-9dc2-49e0408522ad tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 14 microversion: 2.1 time: 0.352425 Dec 02 15:55:27.271794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 399/841] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:26 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 14 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 02 15:55:27.302820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:27.305896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:27.324741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:27.325849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:27.327544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:27.328925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:27.368702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:27.379855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0e4be050-35c7-486d-8589-731fbaac24df tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1598 microversion: 2.1 time: 0.767920 Dec 02 15:55:27.380826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 443/842] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:26 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1598 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:27.405519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4dfb4c8c-13ce-4083-a62b-c2975b003089 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: .version_select at 0x7f02705fc730>, body: {"pool": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:27.567117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9fe51fca-63f1-4be5-a903-e6531ec22b8d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 27619 microversion: 2.20 time: 0.292806 Dec 02 15:55:27.567968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 400/843] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:27 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 27619 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:28.313576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:28.318176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:28.338557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:28.339941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:28.342247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:28.343392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:28.599907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3b496fc3-1115-4645-aa88-758887760c98 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 12315 microversion: 2.1 time: 0.319863 Dec 02 15:55:28.602726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 401/844] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:28 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 12315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:55:28.634928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:28.636331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:28.647078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:28.647420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:28.648329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:28.648831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:28.885956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f1302cb3-89d6-4284-9b2c-b5124ac83633 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 27962 microversion: 2.20 time: 0.281898 Dec 02 15:55:28.887147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 402/845] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:28 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 27962 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:29.622267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:29.623504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:29.633611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:29.634255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:29.638591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:29.639856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:29.902607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b915400c-498d-4d07-84cf-e03686b1fae6 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 18208 microversion: 2.1 time: 0.289822 Dec 02 15:55:29.908946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 403/846] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:29 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 18208 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:55:29.929151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:29.930354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:29.941226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:29.941743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:29.942634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:29.943132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:30.113867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-52fb3f53-5d84-4821-b52e-d89edc0eb5fc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 28216 microversion: 2.20 time: 0.207484 Dec 02 15:55:30.115218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 404/847] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:29 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 28216 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:30.960819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:30.964181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:30.995945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:30.997411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:30.998537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:31.000665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:31.239404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bc12b09d-91ba-4e47-91b6-1a73f69088cc tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 19342 microversion: 2.1 time: 0.325034 Dec 02 15:55:31.240570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 405/848] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:30 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 19342 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:31.264430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:31.266131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:31.276648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:31.277525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:31.278663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:31.279546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:31.508301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b47945b3-531f-418d-bae0-86ca77aa5b2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 28216 microversion: 2.20 time: 0.265213 Dec 02 15:55:31.509435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 406/849] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:31 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 28216 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:31.936697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4dfb4c8c-13ce-4083-a62b-c2975b003089 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.540581 Dec 02 15:55:31.938140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 444/850] 10.222.0.101 () {60 vars in 1165 bytes} [Wed Dec 2 15:55:27 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:31.958788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.190"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:31.962249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:31.973803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:31.974387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:31.975244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:31.975737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:32.138437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Acquired lock "refresh_cache-f24895d2-03f9-430a-ad1f-6aa8f33bbb39" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:55:32.260490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:32.261636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:32.272234 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:32.272716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:32.273785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:32.274283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:32.447754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ecf997e1-d3ba-4f6c-abb7-26e2ec99d9d2 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 21513 microversion: 2.1 time: 0.197408 Dec 02 15:55:32.452488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 445/851] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:32 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 21513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:32.538254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:32.539713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:32.551591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:32.552620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:32.553945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:32.554788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:32.746471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-112bf3fa-6012-4306-8c4b-90b804b024c1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 28507 microversion: 2.20 time: 0.223965 Dec 02 15:55:32.747993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 446/852] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:32 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 28507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:33.477041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:33.485142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:33.499917 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:33.507782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:33.507782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:33.507782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:33.796108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-eb6de96c-97ce-4774-a73e-3df89d582174 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 23226 microversion: 2.1 time: 0.335397 Dec 02 15:55:33.796108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 447/853] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:33 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 23226 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:55:33.835497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:33.837891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:33.862515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:33.867790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:33.869331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:33.869998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:34.228899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7d1420ec-b10d-4bc0-8c0d-22eab287525a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 28675 microversion: 2.20 time: 0.426369 Dec 02 15:55:34.228899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 448/854] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:33 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 28675 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:34.827589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:34.836899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:34.851828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:34.856810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:34.858186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:34.858833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:35.062886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-061168a4-7bc6-4bc4-8bf5-d1b3825249d1 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 24661 microversion: 2.1 time: 0.256208 Dec 02 15:55:35.063573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 449/855] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:34 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 24661 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:55:35.246798 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:35.247750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:35.280547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:35.287667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:35.288886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:35.289576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:35.521049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2d94b15d-53f5-4e7a-a46e-f4c5e0ec2da6 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 28675 microversion: 2.20 time: 0.285430 Dec 02 15:55:35.522380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 450/856] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:35 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 28675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:55:35.557935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:35.558812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:35.576970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:35.577860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:35.578926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:35.579585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:35.664693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:55:35.871945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Building network info cache for instance {{(pid=94391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 15:55:36.187209 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e630dc7-3a33-40c7-a4ab-47214ce8d604 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 204 len: 0 microversion: 2.1 time: 0.661990 Dec 02 15:55:36.188545 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 451/857] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:55:35 2020] DELETE /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:55:36.233513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-006bdd29-6f49-458d-8356-4f1d77d809fd req-4601c9fd-fa20-4bb3-8bb7-c7dbbc61ae07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:36.249690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:36.249690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:36.266535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-006bdd29-6f49-458d-8356-4f1d77d809fd req-4601c9fd-fa20-4bb3-8bb7-c7dbbc61ae07 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:36.266535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-006bdd29-6f49-458d-8356-4f1d77d809fd req-4601c9fd-fa20-4bb3-8bb7-c7dbbc61ae07 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:36.307934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-006bdd29-6f49-458d-8356-4f1d77d809fd req-4601c9fd-fa20-4bb3-8bb7-c7dbbc61ae07 service nova] Creating event network-changed:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:55:36.318092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-006bdd29-6f49-458d-8356-4f1d77d809fd req-4601c9fd-fa20-4bb3-8bb7-c7dbbc61ae07 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126379 Dec 02 15:55:36.318941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 452/858] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:36 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:36.348803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:36.350943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:36.379572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:36.380004 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:36.383313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:36.383836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:36.592454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-448db007-5a79-4906-a5d8-ca7738fe0452 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 26295 microversion: 2.1 time: 0.269375 Dec 02 15:55:36.593179 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 453/859] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:36 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 26295 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:36.613807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:36.614106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:36.625991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:36.626612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:36.628459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:36.629333 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:37.190414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:37.203372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-62b37bfd-c53b-492c-88f1-7e5c4e2fd9dc tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1589 microversion: 2.1 time: 0.608852 Dec 02 15:55:37.209562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 454/860] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:36 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1589 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:37.237103 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:37.246200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:37.285870 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:37.301841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:37.306334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:37.307259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:37.601073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a95416a2-9b2c-42c3-a103-352d0f41bb9d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 28675 microversion: 2.20 time: 0.387842 Dec 02 15:55:37.602018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 455/861] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:37 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 28675 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:37.618671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:37.620339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:37.632316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:37.632850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:37.633738 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:37.634243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:37.817128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ecdac97f-2bef-4f6d-9cd9-b5ba20c96e0a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 27163 microversion: 2.1 time: 0.210749 Dec 02 15:55:37.819487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 456/862] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:37 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 27163 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:37.941804 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Updating instance_info_cache with network_info: [{"id": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b", "address": "fa:16:3e:7e:a1:ad", "network": {"id": "08fcbd27-70ce-4049-b75e-7a1e77449ef3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1671788462-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b3960161fdaa40adbf4ef023f92ffd5d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap257af1d4-f3", "ovs_interfaceid": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 15:55:38.002227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Releasing lock "refresh_cache-f24895d2-03f9-430a-ad1f-6aa8f33bbb39" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:55:38.004191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-714c4d14-4077-4940-a557-02ce9dc45594 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action" status: 202 len: 0 microversion: 2.1 time: 6.057210 Dec 02 15:55:38.010313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 407/863] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:31 2020] POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action => generated 0 bytes in 6059 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Dec 02 15:55:38.035713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-70443f49-a849-4398-8007-7e41e3cc0ff6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: .version_select at 0x7f02710b00d0>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1230431403", "description": "tempest-TestMinimumBasicScenario-1230431403 description"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:38.264255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:38.266629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:38.286482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:38.287934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:38.289729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:38.290974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:39.113435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:39.146105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fa86782f-2b20-41b0-8e83-39105e92c6e3 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1589 microversion: 2.1 time: 0.910802 Dec 02 15:55:39.146742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 408/864] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:38 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1589 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:39.167621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:39.177866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:39.185660 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:39.187131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:39.188477 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:39.189248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:39.362100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-62279414-3f79-4dde-91e4-d1117fe0421e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 29162 microversion: 2.20 time: 0.213873 Dec 02 15:55:39.377354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 409/865] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:39 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 29162 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:39.377354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:39.388057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:39.416417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:39.418134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:39.423096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:39.426540 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:39.508253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-70443f49-a849-4398-8007-7e41e3cc0ff6 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 1.494499 Dec 02 15:55:39.510780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 457/866] 10.222.0.101 () {60 vars in 1175 bytes} [Wed Dec 2 15:55:38 2020] POST /compute/v2.1/os-security-groups => generated 257 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:39.542392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0e6c247c-410a-49ee-adf4-6c38d9f3afaf tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: .version_select at 0x7f027060a730>, body: {"security_group_rule": {"parent_group_id": "b67ed5ca-6e5b-430f-83f7-8c6d94aedad4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:39.867014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6f44bacd-9f71-4bd3-97a2-802a6b805862 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 27762 microversion: 2.1 time: 0.501998 Dec 02 15:55:39.871746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 410/867] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:39 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 27762 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:40.049664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-04bbd01e-8bb9-4655-9d91-ca7414e2fa07 req-7d318f95-712e-4672-bfce-89679d2800fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6186d2-2516-45ad-b5a8-659eda7064a7", "name": "network-vif-unplugged", "status": "completed", "tag": "fc8dafcb-64d1-4db0-a5fe-998da66496fc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:40.078654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:40.078654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:40.113173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-04bbd01e-8bb9-4655-9d91-ca7414e2fa07 req-7d318f95-712e-4672-bfce-89679d2800fe service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:40.116739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-04bbd01e-8bb9-4655-9d91-ca7414e2fa07 req-7d318f95-712e-4672-bfce-89679d2800fe service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:40.169014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-04bbd01e-8bb9-4655-9d91-ca7414e2fa07 req-7d318f95-712e-4672-bfce-89679d2800fe service nova] Creating event network-vif-unplugged:fc8dafcb-64d1-4db0-a5fe-998da66496fc for instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 on hv-cinder-73761 Dec 02 15:55:40.181350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-04bbd01e-8bb9-4655-9d91-ca7414e2fa07 req-7d318f95-712e-4672-bfce-89679d2800fe service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152076 Dec 02 15:55:40.195074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 411/868] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:40 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:40.211173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:40.227159 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:40.238714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:40.240441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:40.242344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:40.243566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:40.807903 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:40.823920 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ca14b4fc-0a0e-45d9-b9f9-6e85194ad059 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1589 microversion: 2.1 time: 0.626174 Dec 02 15:55:40.825262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 412/869] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:40 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1589 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:40.844607 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:40.846972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:40.867716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:40.868467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:40.869498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:40.870161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:41.045550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1846e007-9f96-48b5-8722-d5d946a1dae4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 31506 microversion: 2.20 time: 0.217554 Dec 02 15:55:41.046744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 413/870] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:40 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 31506 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:41.121566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:41.129969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:41.156045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:41.156907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:41.158515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:41.170140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:41.194196 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0e6c247c-410a-49ee-adf4-6c38d9f3afaf tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.663043 Dec 02 15:55:41.195350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 458/871] 10.222.0.101 () {60 vars in 1190 bytes} [Wed Dec 2 15:55:39 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:41.227673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9f34fb42-3903-4e97-b91d-e07175568287 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'create', calling method: .version_select at 0x7f0270762048>, body: {"security_group_rule": {"parent_group_id": "b67ed5ca-6e5b-430f-83f7-8c6d94aedad4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:41.462017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ecd8a989-1e9e-4adf-ae19-7ad43063f817 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 28232 microversion: 2.1 time: 0.409622 Dec 02 15:55:41.464448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 414/872] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:41 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 28232 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:41.851606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:41.855203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:41.875506 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:41.880237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:41.883621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:41.884426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:42.349573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9f34fb42-3903-4e97-b91d-e07175568287 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.141937 Dec 02 15:55:42.350236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 459/873] 10.222.0.101 () {60 vars in 1190 bytes} [Wed Dec 2 15:55:41 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:42.372411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:42.373620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:42.409727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:42.410695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:42.417653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:42.418785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:42.596312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:42.616632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-12cc4755-8dc7-46c4-b27b-498faeb44397 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1589 microversion: 2.1 time: 0.776074 Dec 02 15:55:42.619147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 415/874] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:41 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1589 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:42.667317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1230431403"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:42.668925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:42.671243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f62c5e35-7791-4749-9409-0938dbebea27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 33378 microversion: 2.20 time: 0.319541 Dec 02 15:55:42.672623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 460/875] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:42 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 33378 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:42.691928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:42.696970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:42.702474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:42.703557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:42.704176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:42.706538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:42.718890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:42.724614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:42.728341 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:42.732839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:43.066301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c0eccfb8-81d3-40cb-9d7d-8aec24210028 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 28232 microversion: 2.1 time: 0.391087 Dec 02 15:55:43.068990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 461/876] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:42 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 28232 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:43.521260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.network.security_group_api [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Adding security group b67ed5ca-6e5b-430f-83f7-8c6d94aedad4 to port 257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b Dec 02 15:55:43.656651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:43.658565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:43.680760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:43.682331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:43.683448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:43.684206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:43.887095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:43.898053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c107565e-ab48-4fde-922e-f11f052ab419 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1514 microversion: 2.1 time: 0.251260 Dec 02 15:55:43.899589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 462/877] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:43 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1514 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:43.912518 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:43.914437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:43.929330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:43.930436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:43.931733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:43.932523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:44.113996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e649b735-877c-4ad3-8e85-62d82cb435bc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 34320 microversion: 2.20 time: 0.212623 Dec 02 15:55:44.121381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 463/878] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:43 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 34320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:44.151425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:44.152811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:44.186643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:44.187164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:44.190580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:44.191207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:44.530276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-46962735-94ac-470b-a086-38c6c0c85120 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 28523 microversion: 2.1 time: 0.412503 Dec 02 15:55:44.536684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 464/879] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:44 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 28523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:44.610417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-99c34ac2-351a-44ea-b046-3e4a6a6ef384 req-9cfc9413-61bc-42e5-982d-d9a2f020abee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c6186d2-2516-45ad-b5a8-659eda7064a7", "name": "network-vif-deleted", "tag": "fc8dafcb-64d1-4db0-a5fe-998da66496fc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:44.649958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:44.649958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:44.707750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-99c34ac2-351a-44ea-b046-3e4a6a6ef384 req-9cfc9413-61bc-42e5-982d-d9a2f020abee service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:44.709280 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-99c34ac2-351a-44ea-b046-3e4a6a6ef384 req-9cfc9413-61bc-42e5-982d-d9a2f020abee service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:44.804002 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-99c34ac2-351a-44ea-b046-3e4a6a6ef384 req-9cfc9413-61bc-42e5-982d-d9a2f020abee service nova] Creating event network-vif-deleted:fc8dafcb-64d1-4db0-a5fe-998da66496fc for instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 on hv-cinder-73761 Dec 02 15:55:44.841929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-99c34ac2-351a-44ea-b046-3e4a6a6ef384 req-9cfc9413-61bc-42e5-982d-d9a2f020abee service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294416 Dec 02 15:55:44.849156 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 465/880] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:44 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:44.924490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-875299076", "imageRef": "573f5ed2-525f-407c-b1d1-038250f945c2", "flavorRef": "452"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:45.174790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] validate_networks() for None {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:55:46.056325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f26f2f86-738e-4881-8d4c-c2eb14268dad tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action" status: 202 len: 0 microversion: 2.1 time: 3.420627 Dec 02 15:55:46.057918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 416/881] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:42 2020] POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action => generated 0 bytes in 3424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:46.090551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:55:46.091137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:55:46.091827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:55:46.091959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:55:46.092703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:55:46.129313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.129850 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.130682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.131178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.164766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:46.165578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:46.217708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Getting quotas for project 8591aaa151db43c89c50508ddfdae3f0. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:55:46.230208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Getting quotas for user 2f7c42b9b1524b2bb8c8459f1be15b6f and project 8591aaa151db43c89c50508ddfdae3f0. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:55:46.234009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.234961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.236975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.237669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.287198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:55:46.290831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='573f5ed2-525f-407c-b1d1-038250f945c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:55:46.417910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.419123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.420340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lazy-loading 'fault' on Instance uuid 7c6186d2-2516-45ad-b5a8-659eda7064a7 {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:55:46.441144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a5c1a25b-316e-41d7-8f54-edea1a190e23 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.533877 Dec 02 15:55:46.442403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 466/882] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:55:44 2020] POST /compute/v2.1/servers => generated 382 bytes in 1536 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Dec 02 15:55:46.468683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:46.473653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:46.496309 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.501013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.509485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.510350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.740311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0757c6e9-85d1-4739-8a82-e39306881bf1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 37397 microversion: 2.20 time: 0.296072 Dec 02 15:55:46.741485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 467/883] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:46 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 37397 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:46.763491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:46.765910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:46.776649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.777416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.778508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.779180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.819692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:46.835942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-89885d05-f45d-4e23-9072-c7d19d956992 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 200 len: 1187 microversion: 2.1 time: 0.774530 Dec 02 15:55:46.838054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 417/884] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:46 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 1187 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:46.874096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:46.874791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:46.887719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.888573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:46.889658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:46.890792 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:47.037922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e64ad22e-ffc1-4254-941b-b88e34a86e64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 28690 microversion: 2.1 time: 0.294384 Dec 02 15:55:47.038898 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 468/885] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:46 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 28690 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:47.055405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e7d0d0ab-95d1-4a72-bfc8-6e9a69312d2f tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:47.056702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e7d0d0ab-95d1-4a72-bfc8-6e9a69312d2f tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:47.256648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e7d0d0ab-95d1-4a72-bfc8-6e9a69312d2f tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:47.273008 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e7d0d0ab-95d1-4a72-bfc8-6e9a69312d2f tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1218 microversion: 2.1 time: 0.232474 Dec 02 15:55:47.287586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 469/886] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:47 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:47.340595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:47.366431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0d5a01e4-942e-4a76-8223-518db54a1003 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1774 microversion: 2.1 time: 0.526010 Dec 02 15:55:47.367689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 418/887] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:46 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1774 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:47.465979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-bb6633a6-ecf4-417f-8947-254bde5d8068 req-fe973c15-6981-4091-ba12-85a05fc08419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:47.495711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:47.495711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:47.514929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-bb6633a6-ecf4-417f-8947-254bde5d8068 req-fe973c15-6981-4091-ba12-85a05fc08419 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:47.515769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-bb6633a6-ecf4-417f-8947-254bde5d8068 req-fe973c15-6981-4091-ba12-85a05fc08419 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:47.537736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-bb6633a6-ecf4-417f-8947-254bde5d8068 req-fe973c15-6981-4091-ba12-85a05fc08419 service nova] Creating event network-changed:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:55:47.563275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-bb6633a6-ecf4-417f-8947-254bde5d8068 req-fe973c15-6981-4091-ba12-85a05fc08419 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126210 Dec 02 15:55:47.565629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 419/888] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:47 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:47.661206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-91e3266b-d478-4ced-a142-23aad8431835 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'create', calling method: .version_select at 0x7f027072d9d8>, body: {"keypair": {"name": "tempest-TestShelveInstance-903078200"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:47.711830 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-91e3266b-d478-4ced-a142-23aad8431835 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Getting quotas for project 92c709d41db94ec88054f3a048762c37. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:55:47.717526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-91e3266b-d478-4ced-a142-23aad8431835 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Getting quotas for user dd648b93a99946a88826d00930fb2726 and project 92c709d41db94ec88054f3a048762c37. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:55:47.769901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:47.771018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:47.787018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:47.787536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:47.788575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:47.789086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.068546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-77aa3a82-5bf9-4086-864d-52c2d389d2af tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 38227 microversion: 2.20 time: 0.316212 Dec 02 15:55:48.068546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 420/889] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:47 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 38227 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:48.125874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:48.144236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:48.160199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-91e3266b-d478-4ced-a142-23aad8431835 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Getting quotas for project 92c709d41db94ec88054f3a048762c37. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:55:48.177104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-91e3266b-d478-4ced-a142-23aad8431835 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Getting quotas for user dd648b93a99946a88826d00930fb2726 and project 92c709d41db94ec88054f3a048762c37. Resources: {'key_pairs'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:55:48.185702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:48.186672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.198133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:48.198133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.207380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-91e3266b-d478-4ced-a142-23aad8431835 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.917496 Dec 02 15:55:48.208621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 470/890] 10.222.0.101 () {60 vars in 1153 bytes} [Wed Dec 2 15:55:47 2020] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:48.236762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:48.238310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:48.253137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:48.253658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.255375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:48.256286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.329157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] HTTP exception thrown: Instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 could not be found. Dec 02 15:55:48.331337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Returning 404 to user: Instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:55:48.332710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cf1ba2c9-7a5a-4715-a549-d52879d4fcc8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 404 len: 111 microversion: 2.1 time: 0.262465 Dec 02 15:55:48.333526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 421/891] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:48 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 111 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:55:48.365068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6a22ba0f-050d-4e0c-945e-1addfdd1677e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'create', calling method: .version_select at 0x7f0263cd8950>, body: {"security_group": {"name": "tempest-TestShelveInstance-1418015083", "description": "tempest-TestShelveInstance-1418015083 description"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:48.538288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ec0c50d5-4fc4-4900-8fd8-24a19a37b97e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 28690 microversion: 2.1 time: 0.317922 Dec 02 15:55:48.539727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 471/892] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:48 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 28690 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:48.561984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:48.564091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:48.589616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:48.590787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.592456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:48.593355 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:48.789433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:48.803149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-73edc1d1-a3d1-4123-8589-d08e7ba360d2 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1270 microversion: 2.1 time: 0.261490 Dec 02 15:55:48.803672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 472/893] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:48 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1270 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:48.814480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1332573881", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274750580", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2048584045"}], "block_device_mapping_v2": [{"uuid": "18083daf-f7cb-4e3e-aea1-bd63268e1a09", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:49.131519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] validate_networks() for [('fb4a3f3f-f009-42fb-af5a-e60d7446ffbb', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:55:49.439255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6a22ba0f-050d-4e0c-945e-1addfdd1677e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.103816 Dec 02 15:55:49.440889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 422/894] 10.222.0.101 () {60 vars in 1175 bytes} [Wed Dec 2 15:55:48 2020] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:49.456291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:49.458255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:49.494013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:49.495785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:49.498528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:49.500963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:49.770254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d37f176c-b257-42b5-874a-5c52ab3d1809 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 38227 microversion: 2.20 time: 0.327047 Dec 02 15:55:49.771556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 423/895] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:49 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 38227 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:49.810414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-78691ef3-a249-429c-bb50-3e8ebc75f37f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'create', calling method: .version_select at 0x7f0263beeb70>, body: {"security_group_rule": {"parent_group_id": "45066472-c9db-4980-92e6-7d11978b20f4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:49.974949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:55:49.976424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:55:49.977229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:55:49.978088 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:55:49.978766 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:55:49.999461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:50.000479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:50.002981 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:50.003907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:50.052356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for project e84bacbd36bc4a75898431f75ffae141. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:55:50.067062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for user d269a2a6f71e40538a8b7b7a199ec693 and project e84bacbd36bc4a75898431f75ffae141. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:55:50.262074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:55:50.267233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18083daf-f7cb-4e3e-aea1-bd63268e1a09',volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:55:50.582908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-78691ef3-a249-429c-bb50-3e8ebc75f37f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.808979 Dec 02 15:55:50.589492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 424/896] 10.222.0.101 () {60 vars in 1190 bytes} [Wed Dec 2 15:55:49 2020] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:50.606569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:50.607777 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:50.620065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:50.620520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:50.621723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:50.622389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:50.702491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-33fb0bf7-851d-4ea6-9c1b-cbe10835b863 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 415 microversion: 2.1 time: 1.897328 Dec 02 15:55:50.710429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 473/897] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:55:48 2020] POST /compute/v2.1/servers => generated 415 bytes in 1906 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:55:50.721501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:50.722370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:50.741368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:50.745745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:50.747562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:50.749760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:50.832493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6c2cd4cc-f7ef-46c3-b1a5-dc0c9c4a2759 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 28690 microversion: 2.1 time: 0.239560 Dec 02 15:55:50.833409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 425/898] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:50 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 28690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:50.865272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-929d47f7-3715-45b7-b326-af8ef93ad0ad tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'create', calling method: .version_select at 0x7f0263c06840>, body: {"security_group_rule": {"parent_group_id": "45066472-c9db-4980-92e6-7d11978b20f4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:50.966528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:50.978254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-49c2c24a-a3db-4e14-a08f-1731d95fbe2c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1276 microversion: 2.1 time: 0.266427 Dec 02 15:55:50.979533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 474/899] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:50 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:50.991572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7f803ca3-3fb5-489f-96d3-00978e8c8a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:50.995042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7f803ca3-3fb5-489f-96d3-00978e8c8a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:51.175528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7f803ca3-3fb5-489f-96d3-00978e8c8a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:51.189596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7f803ca3-3fb5-489f-96d3-00978e8c8a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1097 microversion: 2.1 time: 0.207648 Dec 02 15:55:51.200276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 475/900] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:50 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1097 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:51.201661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:51.202837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:51.221971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:51.223354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:51.223909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:51.224470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:51.413031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d19e4213-c8bc-45a9-8ed0-94785c40c9b0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 38242 microversion: 2.20 time: 0.218532 Dec 02 15:55:51.414625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 476/901] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:51 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 38242 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:51.882050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:51.884296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:51.910132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:51.911231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:51.912557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:51.913432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.149498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b95c6d49-4217-472e-a5ba-0cb9f33736f9 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 30411 microversion: 2.1 time: 0.272868 Dec 02 15:55:52.149498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 477/902] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:51 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 30411 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:52.150563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-929d47f7-3715-45b7-b326-af8ef93ad0ad tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.304531 Dec 02 15:55:52.150563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 426/903] 10.222.0.101 () {60 vars in 1190 bytes} [Wed Dec 2 15:55:50 2020] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:52.156042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:52.157153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:52.168422 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.169147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.170231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.170892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.216266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:52.217090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:52.229630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.234598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.237178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.238402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.552644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:52.571794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-74dcdf3a-22a8-457b-aea3-791b8504e31f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1139 microversion: 2.1 time: 0.367279 Dec 02 15:55:52.583258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 427/904] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:52 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1139 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:52.595523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:52.596624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:52.606696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.607139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.608038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.608529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.683259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:52.700732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2e80e278-aa48-417d-ba81-054710ad9321 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.575338 Dec 02 15:55:52.715581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 478/905] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:52 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:52.819406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0ed82136-2017-4f7e-81a3-a7addc60c7ff tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 200 len: 38370 microversion: 2.20 time: 0.234508 Dec 02 15:55:52.820146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 428/906] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:52 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 38370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:52.849277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:52.849277 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:52.884283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.884910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:52.885828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:52.886456 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.013728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fce0c1ef-5d8d-4a18-aad1-3c0927c2d666 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/ips" status: 200 len: 152 microversion: 2.20 time: 0.186814 Dec 02 15:55:53.015681 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 479/907] 10.222.0.101 () {60 vars in 1284 bytes} [Wed Dec 2 15:55:52 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/ips => generated 152 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:53.141104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:53.145815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:53.183087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:53.183961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.185608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:53.187530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.410576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-db28113c-5489-4e6d-b79f-ccd84489cbe3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 32059 microversion: 2.1 time: 0.278833 Dec 02 15:55:53.411300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 429/908] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:53 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 32059 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:53.598439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:53.600589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:53.629557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:53.630248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.631255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:53.631848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.734030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:53.734825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:53.759358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:53.759868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.760779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:53.761282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:53.891153 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:53.927224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-01b6125f-eab7-4a4c-bc2e-228969c23917 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1203 microversion: 2.1 time: 0.340306 Dec 02 15:55:53.940157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 480/909] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:53 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1203 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:54.431947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:54.433352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:54.455190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:54.459760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:54.462575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:54.463926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:54.746677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d6f0ee80-eb41-4aa9-9b1c-20470d08f17b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 33391 microversion: 2.1 time: 0.325735 Dec 02 15:55:54.753062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 481/910] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:54 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 33391 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 02 15:55:54.965895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:54.966671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:54.976357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:54.976781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:54.977633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:54.978122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:55.091126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:55.113621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c671454f-a7f4-43de-a618-505b40f71137 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 1.395049 Dec 02 15:55:55.124411 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 430/911] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:53 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:55.142323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:55.163297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-13135790-bd2f-44d8-a86f-1fbde9e55223 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1213 microversion: 2.1 time: 0.207890 Dec 02 15:55:55.171873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 482/912] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:54 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1213 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:55:55.767170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:55.768415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:55.780868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:55.781391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:55.782790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:55.783296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:55.955334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bac175d6-4cd7-41bb-984a-0ba308cdc92c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 34021 microversion: 2.1 time: 0.197587 Dec 02 15:55:55.960922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 431/913] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:55 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 34021 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:56.105293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:56.106580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:56.116759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:56.117655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:56.118818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:56.119799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:56.151066 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:56.153143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:56.167528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:56.168608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:56.169653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:56.171297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:56.247217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lazy-loading 'flavor' on Instance uuid e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:55:56.915202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2ea1bdb8-2de5-4b24-82a5-84872fad8021 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 202 len: 0 microversion: 2.20 time: 0.821165 Dec 02 15:55:56.916011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 483/914] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:55:56 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:55:56.935493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-03fec66f-e741-4415-a48a-f33f52fe1863 req-88656bd8-f4e2-4562-8e61-5ef2bfc758f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f65c01-728a-48c5-8300-304df54b6f75", "tag": "3bdece54-2aec-4ff7-be16-f74e758675ae"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:56.947217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:55:56.947217 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:55:56.958695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-03fec66f-e741-4415-a48a-f33f52fe1863 req-88656bd8-f4e2-4562-8e61-5ef2bfc758f5 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:56.959214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-03fec66f-e741-4415-a48a-f33f52fe1863 req-88656bd8-f4e2-4562-8e61-5ef2bfc758f5 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:56.975521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:56.985698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-03fec66f-e741-4415-a48a-f33f52fe1863 req-88656bd8-f4e2-4562-8e61-5ef2bfc758f5 service nova] Creating event network-changed:3bdece54-2aec-4ff7-be16-f74e758675ae for instance 20f65c01-728a-48c5-8300-304df54b6f75 on hv-cinder-73761 Dec 02 15:55:56.990846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-03fec66f-e741-4415-a48a-f33f52fe1863 req-88656bd8-f4e2-4562-8e61-5ef2bfc758f5 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073290 Dec 02 15:55:56.991728 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 484/915] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:55:56 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:55:57.000139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-05677ea0-5d91-46a6-94f2-311e5e62a724 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.861014 Dec 02 15:55:57.005529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 432/916] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:56 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:57.018488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:57.020387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:57.036988 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:57.037505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:57.038394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:57.038904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:57.056307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:57.058122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:57.075171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:57.076128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:57.077757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:57.078671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:57.322910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:57.338568 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0fbc83eb-70dd-4845-b608-359065874cbb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.343958 Dec 02 15:55:57.339314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 485/917] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:56 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:57.354109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:57.355307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:57.365207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:57.365938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:57.366980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:57.367734 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:57.535696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b0c76cf2-7c4b-4216-a061-8b308be20f13 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 35164 microversion: 2.1 time: 0.194289 Dec 02 15:55:57.536601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 486/918] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:57 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 35164 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:57.829888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:57.845474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:57.852343 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:57.853599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b9bf1532-432e-4c32-a6bb-72b291933d17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.846371 Dec 02 15:55:57.854199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 433/919] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:55:57 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:55:58.033440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:58.034639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:58.043608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.044211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.045086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.045583 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.374450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:58.377701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:58.390510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.391674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.393126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.394010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.467479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:58.477627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0cf93863-0f7b-40d9-b5a8-b350bee4c545 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.455088 Dec 02 15:55:58.480688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 487/920] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:58 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:58.504215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:58.505425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:58.513641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.514419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.515395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.515908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.851362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42908a03-45ef-47fe-b62b-2bb9c2ab20b7 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action" status: 202 len: 0 microversion: 2.1 time: 0.357439 Dec 02 15:55:58.854851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 488/921] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:58 2020] POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:55:58.879419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:55:58.880552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:58.889630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.890678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:58.890979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:58.892289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:59.098128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-56844f3c-c9b7-48b9-b077-9b78d8b26837 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 36154 microversion: 2.1 time: 0.233602 Dec 02 15:55:59.101720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 489/922] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:55:58 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 36154 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:55:59.118879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:59.119696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:59.131138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:59.131617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:59.132828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:59.133369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:59.608794 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:59.620735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b3685a95-c19c-419f-b709-99aaf5c47615 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 1.265778 Dec 02 15:55:59.621337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 434/923] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:58 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:59.634115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:59.634845 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:59.643646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:59.644189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:59.645034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:59.645674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:59.899897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:55:59.917756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e539bb84-4365-4ceb-a1ce-31bc97839be5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1766 microversion: 2.1 time: 0.814089 Dec 02 15:55:59.918886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 490/924] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:59 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1766 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:55:59.953216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:55:59.956073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:55:59.973136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:59.974042 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:55:59.975649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:55:59.976585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.431931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:00.470932 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:00.478665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:00.480264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1fad6f1e-5d6f-4975-adec-69c9afdf8bf4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.857647 Dec 02 15:56:00.481023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 435/925] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:55:59 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:00.493207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:00.494610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:00.503720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.504780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.505849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.506599 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.559860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:00.597444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c99d9d9-9e25-4691-a141-99471bb01195 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.676393 Dec 02 15:56:00.598618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 491/926] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:55:59 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:00.618041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-14b43493-7b35-4a0b-8a9c-24736bcf85a2 req-70ca9bf3-200f-4da6-ba4a-7e4d2587b091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78341935-3dc2-452e-a748-a46473230141", "tag": "a1b80e49-be90-44c1-870d-de3cc7b6ba08"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:00.626628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:00.626628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:00.637965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-14b43493-7b35-4a0b-8a9c-24736bcf85a2 req-70ca9bf3-200f-4da6-ba4a-7e4d2587b091 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.638530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-14b43493-7b35-4a0b-8a9c-24736bcf85a2 req-70ca9bf3-200f-4da6-ba4a-7e4d2587b091 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.660081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-14b43493-7b35-4a0b-8a9c-24736bcf85a2 req-70ca9bf3-200f-4da6-ba4a-7e4d2587b091 service nova] Creating event network-changed:a1b80e49-be90-44c1-870d-de3cc7b6ba08 for instance 78341935-3dc2-452e-a748-a46473230141 on hv-cinder-73761 Dec 02 15:56:00.665016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-14b43493-7b35-4a0b-8a9c-24736bcf85a2 req-70ca9bf3-200f-4da6-ba4a-7e4d2587b091 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057576 Dec 02 15:56:00.665709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 492/927] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:00 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:00.677168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:00.677926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:00.685933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.686439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.687276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.687768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.763696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-465b73b5-871e-4cb8-8a11-25d4b5130003 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 37371 microversion: 2.1 time: 0.280897 Dec 02 15:56:00.765927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 436/928] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:56:00 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 37371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:56:00.948464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:00.958125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:00.958893 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:00.961426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2ca7fdab-462a-4c0f-b393-72169f520041 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.294413 Dec 02 15:56:00.963612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 493/929] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:00 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:00.977586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.978092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:00.978947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:00.979453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:01.410799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:01.421129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a22108de-f690-41dd-a791-913f8fb2944e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.484206 Dec 02 15:56:01.421753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 437/930] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:00 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:01.506782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:01.507463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:01.515952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:01.516591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:01.517494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:01.517984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:01.636887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:01.638212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:01.647326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:01.648332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:01.649435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:01.649942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:01.797124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:01.814436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:01.821614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:01.822872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1a75c1d7-5816-4ee5-91e5-50937eb801a1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.326257 Dec 02 15:56:01.823472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 494/931] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:01 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:01.834667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:01.835795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:01.846763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:01.847212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:01.848144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:01.848808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.008399 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d7a02f56-ac79-455a-8b83-d8c1ccfe7cee tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 38130 microversion: 2.1 time: 0.182733 Dec 02 15:56:02.014346 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 495/932] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:56:01 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 38130 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:56:02.033767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:02.035145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:02.052562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.053498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.055047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.055941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.167780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:02.187637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e0a566c-74f8-46b2-9959-74abb1b10a62 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.560088 Dec 02 15:56:02.190085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 438/933] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:01 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:02.331829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:02.341910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bb9bbd40-e710-4fa1-a79a-5ff9a6326b1e tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.330226 Dec 02 15:56:02.342558 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 496/934] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:02 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:02.459550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:02.460283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:02.468948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.470322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.471497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.472079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.731271 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-9838db35-fb06-4fc7-b6c9-27fbddbe7e80 req-ab3f6a8b-0164-4b65-9957-617ea924593b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f65c01-728a-48c5-8300-304df54b6f75", "name": "network-vif-plugged", "status": "completed", "tag": "3bdece54-2aec-4ff7-be16-f74e758675ae"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:02.740095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:02.740095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:02.749526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-9838db35-fb06-4fc7-b6c9-27fbddbe7e80 req-ab3f6a8b-0164-4b65-9957-617ea924593b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.750032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-9838db35-fb06-4fc7-b6c9-27fbddbe7e80 req-ab3f6a8b-0164-4b65-9957-617ea924593b service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.770206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-9838db35-fb06-4fc7-b6c9-27fbddbe7e80 req-ab3f6a8b-0164-4b65-9957-617ea924593b service nova] Creating event network-vif-plugged:3bdece54-2aec-4ff7-be16-f74e758675ae for instance 20f65c01-728a-48c5-8300-304df54b6f75 on hv-cinder-73761 Dec 02 15:56:02.777362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-9838db35-fb06-4fc7-b6c9-27fbddbe7e80 req-ab3f6a8b-0164-4b65-9957-617ea924593b service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055177 Dec 02 15:56:02.778260 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 497/935] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:02 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:56:02.788129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:02.798100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e53d4162-9895-4700-a412-6b8a974942ec tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.360091 Dec 02 15:56:02.798839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 439/936] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:02 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:02.855257 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:02.856057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:02.864474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.864987 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:02.865841 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:02.866340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.029669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:03.030824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:03.041723 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.043467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.043896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.044827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.163155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:03.180447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:03.187102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:03.189379 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-61d82dcb-19f1-4c0a-bc73-2f66df02203e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.345166 Dec 02 15:56:03.189909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 498/937] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:02 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:03.227637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:03.228504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:03.238452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.238979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.239895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.240432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.254895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3039d9f5-56a0-4a4c-a0fd-b5e1398e80d5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 38211 microversion: 2.1 time: 0.234709 Dec 02 15:56:03.256791 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 440/938] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:56:03 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 38211 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:56:03.368099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:03.369289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:03.383955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.384824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.385885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.386562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.533816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:03.543823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-45eed010-6fa7-4889-8b4c-a1998485cff7 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.326648 Dec 02 15:56:03.544630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 499/939] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:03 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:03.687169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:03.696823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-462286da-eddb-42af-8bb7-b1112ab0d14f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.339658 Dec 02 15:56:03.697466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 441/940] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:03 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:03.822475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:03.824299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:03.833717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.834249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:03.835173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:03.835664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.070843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:04.081614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-01c9f93c-2665-4800-ab26-cf8e02ca1e0e tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.268966 Dec 02 15:56:04.082227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 500/941] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:03 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:04.216147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:04.216823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:04.225810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.226317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.227160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.227649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.275232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:04.276326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:04.287683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.288359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.289357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.289952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.452394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bf57a545-9b2c-4961-a737-bd554ef8e1b5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action" status: 200 len: 38340 microversion: 2.1 time: 0.187722 Dec 02 15:56:04.453118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 501/942] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:56:04 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/action => generated 38340 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:56:04.462157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:04.471065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:04.471709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:04.478149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:04.480514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.481020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.481864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.482349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.484815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:04.486087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-98868e1a-5a0f-446b-a492-6e0d8c15bd94 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.279319 Dec 02 15:56:04.486677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 442/943] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:04 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:04.553387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0425795a-3f0c-4e1d-8a35-6fefb3f1e2ce tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/ips" status: 200 len: 145 microversion: 2.1 time: 0.092913 Dec 02 15:56:04.553943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 502/944] 10.222.0.101 () {58 vars in 1243 bytes} [Wed Dec 2 15:56:04 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:56:04.567528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:04.568262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:04.581134 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.581480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.582331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.582825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.722996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:04.724077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:04.732446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.733183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.734523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:04.735186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:04.832908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:04.846195 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b0d63188-0cde-4964-9804-e61ddafc8565 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1318 microversion: 2.1 time: 0.287836 Dec 02 15:56:04.847316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 443/945] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:04 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:05.016166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:05.026154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-bff9283b-2a32-4944-a8cd-15fdedbc7a25 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.314554 Dec 02 15:56:05.027667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 503/946] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:04 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:05.133951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:05.140825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:05.158032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:05.158713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:05.164184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:05.164837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:05.417269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:05.428501 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-94910c61-e67b-4d4a-937f-23b0f3c593a1 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.332498 Dec 02 15:56:05.429136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 444/947] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:05 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:05.511729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:05.512467 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:05.521980 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:05.522502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:05.523368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:05.523869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:05.752676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:05.768306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:05.774950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:05.776204 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e52249c2-cd58-428a-a127-2ef62bce7437 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.273960 Dec 02 15:56:05.776786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 504/948] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:05 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:05.870968 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:05.871638 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:05.880731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:05.881235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:05.882082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:05.882575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.052939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:06.053374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:06.062322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.062831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.064309 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.064832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.134985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:06.144832 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-93643239-b20f-453f-8a28-c2aeff7163d1 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1468 microversion: 2.1 time: 0.283137 Dec 02 15:56:06.145446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 445/949] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:05 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:06.233054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:06.233605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:06.242489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.242996 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.243835 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.244349 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.323877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:06.338826 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f7e25058-dbed-47be-980e-6e279efe9e63 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.296433 Dec 02 15:56:06.339788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 505/950] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:06 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:06.404340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9e78b5f-e93c-428e-9ec8-47d34a50fd13"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:06.405806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:06.416459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.416953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.417824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.418315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.473481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:56:06.802253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1d081c34-a6c3-44d5-8b6e-3d2fe5ee2501 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "DELETE /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 204 len: 0 microversion: 2.1 time: 0.578829 Dec 02 15:56:06.802891 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 446/951] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:56:06 2020] DELETE /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 02 15:56:06.814649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:06.830618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:06.830618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.830618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:06.830618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:06.831110 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.189262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:07.199125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-44734db1-6846-4380-ac3d-f78ed082c8ed tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.394962 Dec 02 15:56:07.199742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 447/952] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:06 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:07.210237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:07.210913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:07.220131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:07.227391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.227391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:07.227391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.304261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-95fb15cb-4598-4616-904c-514abb87934d tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.910093 Dec 02 15:56:07.305092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 506/953] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:56:06 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:56:07.322235 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:07.323207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:07.334511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:07.336164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.336420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:07.336923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.493282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:07.512440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:07.521859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:07.523567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-205cba68-4ff6-4670-83bb-cf5b4f6b32b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.322776 Dec 02 15:56:07.524526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 448/954] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:07 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:07.548433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:07.549121 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:07.557372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:07.557816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.558668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:07.559160 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:07.607035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:07.616821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-42fb491f-1a95-4238-a738-b922b43aa4cc tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1474 microversion: 2.1 time: 0.309838 Dec 02 15:56:07.618525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 507/955] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:07 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:07.798290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:07.807286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-eae20c25-0fb0-4c97-808c-12685327b703 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.269327 Dec 02 15:56:07.807922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 449/956] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:07 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:08.234182 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:08.235282 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:08.244440 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.244952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.245807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.246287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.481279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:08.492175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ed38d0d7-29b2-4c77-b78f-a3eb6b33ecfd tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.276781 Dec 02 15:56:08.492836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 508/957] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:08 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:08.548592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:08.549269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:08.557393 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.557904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.558752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.559240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.644843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:08.645610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:08.654708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.655266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.656087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.656641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.817102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:08.833389 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:08.840670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:08.841965 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-91079c86-4594-4f0d-9fa8-5cec7a4cfff9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.303093 Dec 02 15:56:08.842572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 450/958] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:08 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:08.853984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:08.854922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:08.863726 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.864247 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.865101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:08.865588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:08.918113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:08.929538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f0b0f6bb-78d8-4ce2-9627-628148143e8c tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1474 microversion: 2.1 time: 0.295213 Dec 02 15:56:08.930162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 509/959] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:08 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1474 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:09.123243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:09.133453 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e92e9185-d4a6-427c-8733-f9df1df9b936 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.289685 Dec 02 15:56:09.134076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 451/960] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:08 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:09.519482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:09.520206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:09.528674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:09.529184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:09.530040 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:09.530585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:09.772563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:09.783593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9256a6ee-45b8-4ad6-bc91-e6ab792010c3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.275479 Dec 02 15:56:09.784289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 510/961] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:09 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:09.877105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:09.877755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:09.886464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:09.887043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:09.887823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:09.888461 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:09.958989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:09.959779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:09.969600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:09.970682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:09.970682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:09.971499 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:10.309330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:10.317714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:10.330254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1070988f-1de4-4845-b838-541cad243317 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1474 microversion: 2.1 time: 0.383683 Dec 02 15:56:10.331859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 511/962] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:09 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1474 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:10.355554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:10.356931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:10.373758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:10.374695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:10.377419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:10.378432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:10.404505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:10.436925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:10.441060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-68b12208-1fdc-4b73-9c7d-f43bf4f50642 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.573614 Dec 02 15:56:10.442290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 452/963] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:09 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:10.764429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ab7b8a0b-9fe5-419d-9617-8fac935735ef req-8cf33997-97ef-4f00-9080-e2d762817eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78341935-3dc2-452e-a748-a46473230141", "name": "network-vif-plugged", "status": "completed", "tag": "a1b80e49-be90-44c1-870d-de3cc7b6ba08"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:10.790879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:10.790879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:10.825340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ab7b8a0b-9fe5-419d-9617-8fac935735ef req-8cf33997-97ef-4f00-9080-e2d762817eb1 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:10.826595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ab7b8a0b-9fe5-419d-9617-8fac935735ef req-8cf33997-97ef-4f00-9080-e2d762817eb1 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:10.877720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ab7b8a0b-9fe5-419d-9617-8fac935735ef req-8cf33997-97ef-4f00-9080-e2d762817eb1 service nova] Creating event network-vif-plugged:a1b80e49-be90-44c1-870d-de3cc7b6ba08 for instance 78341935-3dc2-452e-a748-a46473230141 on hv-cinder-73761 Dec 02 15:56:10.889132 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ab7b8a0b-9fe5-419d-9617-8fac935735ef req-8cf33997-97ef-4f00-9080-e2d762817eb1 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161347 Dec 02 15:56:10.891329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 453/964] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:10 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:10.939296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:10.940494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:10.956452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:10.967374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:10.969923 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:10.970973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:10.971721 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:10.975846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9552395c-f613-498b-8bac-244005b38469 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.641925 Dec 02 15:56:10.988431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 512/965] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:10 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:11.004912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-e234bc28-3a14-4e4d-92f6-088b62c3e299 req-c26f247c-201a-4b10-b533-2b32aacb8c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f65c01-728a-48c5-8300-304df54b6f75", "name": "network-vif-deleted", "tag": "3bdece54-2aec-4ff7-be16-f74e758675ae"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:11.012092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:11.012092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:11.027698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e234bc28-3a14-4e4d-92f6-088b62c3e299 req-c26f247c-201a-4b10-b533-2b32aacb8c25 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:11.027698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-e234bc28-3a14-4e4d-92f6-088b62c3e299 req-c26f247c-201a-4b10-b533-2b32aacb8c25 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:11.043874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-e234bc28-3a14-4e4d-92f6-088b62c3e299 req-c26f247c-201a-4b10-b533-2b32aacb8c25 service nova] Creating event network-vif-deleted:3bdece54-2aec-4ff7-be16-f74e758675ae for instance 20f65c01-728a-48c5-8300-304df54b6f75 on hv-cinder-73761 Dec 02 15:56:11.050334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-e234bc28-3a14-4e4d-92f6-088b62c3e299 req-c26f247c-201a-4b10-b533-2b32aacb8c25 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058394 Dec 02 15:56:11.051393 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 513/966] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:10 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:11.311852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:11.323430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dd90e273-5e16-452e-ad03-6fffa29501ee tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1771 microversion: 2.1 time: 0.425698 Dec 02 15:56:11.324077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 454/967] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:10 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1771 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:11.357075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:11.357853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:11.366927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:11.367431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:11.368303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:11.368795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:11.453531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:11.454944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:11.455623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lazy-loading 'fault' on Instance uuid 20f65c01-728a-48c5-8300-304df54b6f75 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:56:11.468443 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:11.469793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:11.479940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:11.480484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:11.481348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:11.481847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:11.529852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:11.541514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-12fe38c2-a57f-4863-b9f7-86f307187b9d tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1308 microversion: 2.1 time: 0.194215 Dec 02 15:56:11.542460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 514/968] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:11 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:11.764081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:11.779659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:11.787138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:11.788408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-01979f85-f9cc-4d22-aa90-0f64aa5f955c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.330520 Dec 02 15:56:11.789035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 455/969] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:11 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:12.011761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:12.012561 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:12.021100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.021731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.022584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.023076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.317265 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:12.326469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-30bc372a-9d9d-43ab-9c3b-b7f000e154b0 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1276 microversion: 2.1 time: 0.325645 Dec 02 15:56:12.327091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 515/970] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:11 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1276 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:12.349865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:12.350526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:12.359250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.360595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.361680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.362434 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.567951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:12.568650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:12.578900 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.579416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.580326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.580815 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.623323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:12.633397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0f13aef3-cf20-4b48-82e1-5e0dc42195b5 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1774 microversion: 2.1 time: 0.294414 Dec 02 15:56:12.635087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 456/971] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:12 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1774 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:12.669052 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.669567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.670072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lazy-loading 'fault' on Instance uuid 20f65c01-728a-48c5-8300-304df54b6f75 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:56:12.737906 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f7c42b9b1524b2bb8c8459f1be15b6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8591aaa151db43c89c50508ddfdae3f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:12.746882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c2710abf-7d1b-46d3-8a0c-7b4e02aee660 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 200 len: 1308 microversion: 2.1 time: 0.188997 Dec 02 15:56:12.747483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 516/972] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:12 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:12.814611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:12.815302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:12.824612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.825122 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:12.825970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:12.826460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.069261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:13.086362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:13.095831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:13.098054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f42a8897-1e93-4c1c-b9ed-a681343233da tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.292934 Dec 02 15:56:13.098054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 457/973] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:12 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:13.352085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:13.352689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:13.361039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:13.361553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.362400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:13.362890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.606685 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:13.616104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c77d7f93-656d-4b1e-bdb7-0aa7903356f2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1463 microversion: 2.1 time: 0.274719 Dec 02 15:56:13.616942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 517/974] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:13 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1463 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:13.638869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:13.639557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:13.648186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:13.648701 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.649555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:13.650054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.772571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:13.773358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] [instance: 20f65c01-728a-48c5-8300-304df54b6f75] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:13.783125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:13.783741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.788230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:13.788230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:13.856455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] HTTP exception thrown: Instance 20f65c01-728a-48c5-8300-304df54b6f75 could not be found. Dec 02 15:56:13.862338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] Returning 404 to user: Instance 20f65c01-728a-48c5-8300-304df54b6f75 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:56:13.862338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c4e72dc-c14f-412d-a62a-4862a3edaf55 tempest-VolumesNegativeTest-943869642 tempest-VolumesNegativeTest-943869642] 10.222.0.101 "GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75" status: 404 len: 111 microversion: 2.1 time: 0.096976 Dec 02 15:56:13.862338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 518/975] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:13 2020] GET /compute/v2.1/servers/20f65c01-728a-48c5-8300-304df54b6f75 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:56:14.038006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:14.049942 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b23ad767-bb18-4906-a1ff-0d55ddcd2a80 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1463 microversion: 2.1 time: 0.420256 Dec 02 15:56:14.051359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 458/976] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:13 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1463 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:14.096852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c28dd2e8-a4f4-40d0-8023-a0e1c5fe534c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f027072d840>, body: {"pool": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:14.122262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:14.122828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:14.131635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:14.132173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:14.133072 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:14.133617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:14.604973 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:14.622111 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:14.629492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:14.630742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a18141f1-9075-42cb-8f5d-ed6025efd084 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1748 microversion: 2.20 time: 0.517887 Dec 02 15:56:14.631580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 459/977] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:14 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1748 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:15.184688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1925385304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-903078200", "security_groups": [{"name": "tempest-TestShelveInstance-1418015083"}], "networks": [{"uuid": "b49751da-eb0e-4ecb-880c-88dd1ff589c9"}], "block_device_mapping_v2": [{"uuid": "c77cd3cf-8f55-4804-acf2-c2d2b5bbd5d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:15.535639 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] validate_networks() for [('b49751da-eb0e-4ecb-880c-88dd1ff589c9', None, None, None)] {{(pid=94391) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:56:16.614137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Flavor limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:56:16.618229 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Image limits 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:56:16.623167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Flavor pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:56:16.624035 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Image pref 0:0:0 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:56:16.624755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:56:16.643022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:16.643451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:16.644347 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:16.647710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:16.681646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Getting quotas for project 92c709d41db94ec88054f3a048762c37. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:56:16.686957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Getting quotas for user dd648b93a99946a88826d00930fb2726 and project 92c709d41db94ec88054f3a048762c37. Resources: {'ram', 'cores', 'instances'} {{(pid=94391) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:56:16.841566 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Going to run 1 instances... {{(pid=94391) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:56:16.844875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c77cd3cf-8f55-4804-acf2-c2d2b5bbd5d3',volume_size=None,volume_type=None)] {{(pid=94391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:56:17.299569 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a0601599-df7f-4eb9-a170-1958c4779595 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 412 microversion: 2.1 time: 2.127079 Dec 02 15:56:17.301220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 460/978] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:56:15 2020] POST /compute/v2.1/servers => generated 412 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Dec 02 15:56:17.333953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:17.335646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:17.348018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:17.348704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:17.349884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:17.350402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:17.592902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d66d6e3e-61ce-4ebe-9985-28dc4358ea64 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.289482 Dec 02 15:56:17.593575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 461/979] 10.222.0.101 () {58 vars in 1297 bytes} [Wed Dec 2 15:56:17 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments => generated 197 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:17.604543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c28dd2e8-a4f4-40d0-8023-a0e1c5fe534c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.538493 Dec 02 15:56:17.605991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 519/980] 10.222.0.101 () {60 vars in 1165 bytes} [Wed Dec 2 15:56:14 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:17.615663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:17.619842 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-53f0f106-bf0c-49c0-ba6a-5f90a8c1c845 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:17.620597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-53f0f106-bf0c-49c0-ba6a-5f90a8c1c845 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:17.620729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:17.635363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:17.635881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:17.636803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:17.637281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:17.784556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-53f0f106-bf0c-49c0-ba6a-5f90a8c1c845 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:17.794593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-53f0f106-bf0c-49c0-ba6a-5f90a8c1c845 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1091 microversion: 2.1 time: 0.187397 Dec 02 15:56:17.795226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 520/981] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:17 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1091 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:17.816463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:17.820043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:17.832924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:17.833823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:17.834924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:17.835626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:17.964735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f7198e9d-c086-4a48-87e7-5a92ccffb512 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/b9e78b5f-e93c-428e-9ec8-47d34a50fd13" status: 200 len: 194 microversion: 2.1 time: 0.167788 Dec 02 15:56:17.965963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 521/982] 10.222.0.101 () {58 vars in 1408 bytes} [Wed Dec 2 15:56:17 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/b9e78b5f-e93c-428e-9ec8-47d34a50fd13 => generated 194 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:17.986846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:18.007909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:18.015447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'action', calling method: .version_select at 0x7f027202e048>, body: {"addFloatingIp": {"address": "172.27.0.223"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:18.016659 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:18.022935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:18.023214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3bd8b983-ecf8-456d-86e0-d11c188091ce tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.419204 Dec 02 15:56:18.023214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 462/983] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:17 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:18.037902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:18.038567 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:18.050130 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:18.050589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:18.216249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Acquired lock "refresh_cache-78341935-3dc2-452e-a748-a46473230141" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:56:18.820294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:18.820972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:18.847370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:18.847635 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:18.848963 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:18.850611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:19.083086 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:19.101344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8264d892-0928-4b88-9861-c7d8806a75d1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1133 microversion: 2.1 time: 0.291391 Dec 02 15:56:19.102578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 463/984] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:18 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1133 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:19.115032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:19.116323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:19.130215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:19.132602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:19.136497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:19.137268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:19.554860 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:19.575852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:19.585187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:19.586717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1f94e7b8-ddae-49d8-81ce-98c1613d700c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.482828 Dec 02 15:56:19.587472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 464/985] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:19 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:20.129725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:20.130516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:20.181887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:20.182416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:20.183262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:20.183764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:20.518743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:20.545869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-93a6cc22-fa04-491f-8437-7bafd33ae9f5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1197 microversion: 2.1 time: 0.426438 Dec 02 15:56:20.546824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 465/986] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:20 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1197 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:20.636880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:20.638786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:20.660081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:20.661778 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:20.665076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:20.666539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:21.357859 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:21.398075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:21.405480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:21.408023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d556f3fc-315a-4cc4-9293-17e601aa22b3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.796058 Dec 02 15:56:21.426550 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 466/987] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:20 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:21.439368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcfde3d1-13e8-44ee-a87b-cd26698681d8"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:21.440886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:21.450707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:21.451385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:21.452619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:21.453688 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:21.724215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Building network info cache for instance {{(pid=94390) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 15:56:22.461591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-55fce400-819b-4ffe-96d2-44dda5cb1cf3 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033345 Dec 02 15:56:22.463166 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 467/988] 10.222.0.101 () {60 vars in 1318 bytes} [Wed Dec 2 15:56:21 2020] POST /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:22.488621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:22.499530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:22.518711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:22.527530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:22.532053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:22.532053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:23.812992 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Updating instance_info_cache with network_info: [{"id": "a1b80e49-be90-44c1-870d-de3cc7b6ba08", "address": "fa:16:3e:b5:b4:07", "network": {"id": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1674399377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e84bacbd36bc4a75898431f75ffae141", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa1b80e49-be", "ovs_interfaceid": "a1b80e49-be90-44c1-870d-de3cc7b6ba08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94390) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 15:56:24.118165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Releasing lock "refresh_cache-78341935-3dc2-452e-a748-a46473230141" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:56:24.121012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f896f078-6b2d-40b4-8584-0aae17bf1cc4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141/action" status: 202 len: 0 microversion: 2.1 time: 6.151839 Dec 02 15:56:24.121012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 522/989] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:56:17 2020] POST /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141/action => generated 0 bytes in 6153 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 02 15:56:24.131135 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-b9ab8d97-1210-4a51-8f69-d7719de4e0f5 req-66157542-3f31-436f-bfca-d2f81c7e7174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78341935-3dc2-452e-a748-a46473230141", "tag": "a1b80e49-be90-44c1-870d-de3cc7b6ba08"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:24.142904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:24.142904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:24.153532 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b9ab8d97-1210-4a51-8f69-d7719de4e0f5 req-66157542-3f31-436f-bfca-d2f81c7e7174 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:24.154019 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b9ab8d97-1210-4a51-8f69-d7719de4e0f5 req-66157542-3f31-436f-bfca-d2f81c7e7174 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:24.179294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-b9ab8d97-1210-4a51-8f69-d7719de4e0f5 req-66157542-3f31-436f-bfca-d2f81c7e7174 service nova] Creating event network-changed:a1b80e49-be90-44c1-870d-de3cc7b6ba08 for instance 78341935-3dc2-452e-a748-a46473230141 on hv-cinder-73761 Dec 02 15:56:24.185595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-b9ab8d97-1210-4a51-8f69-d7719de4e0f5 req-66157542-3f31-436f-bfca-d2f81c7e7174 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064135 Dec 02 15:56:24.185964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 523/990] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:24 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:24.197962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:24.199291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:24.212034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:24.215105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:24.218184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:24.219337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:24.483274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:24.524313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d7c9ef8a-b633-4e84-be92-e613434ad80b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1279 microversion: 2.1 time: 2.059550 Dec 02 15:56:24.532250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 468/991] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:22 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1279 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:24.576151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:24.608868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:24.620047 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:24.622206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-11365b29-4f64-4a3d-87f0-6aaa99eb72ee tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.434963 Dec 02 15:56:24.623547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 524/992] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:24 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:25.551953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:25.556058 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:25.566873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:25.567724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:25.568914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:25.569649 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:25.684361 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:25.685614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:25.708092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:25.708438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:25.709492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:25.709983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:26.022823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:26.057967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:26.088803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:26.090720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5f32ffbc-a019-4d21-b175-b809c6a8a951 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.420754 Dec 02 15:56:26.104142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 525/993] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:25 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:26.326518 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:26.348889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6ab872f1-a37b-4b9f-847b-6ecd2c59e66a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.807151 Dec 02 15:56:26.351883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 469/994] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:25 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:26.415017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-71da359c-5a8c-4927-a1dc-f5caeab8f970 req-6795d3a3-3dd1-424c-88c4-154585a9a613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:26.473749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:26.473749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:26.504606 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-71da359c-5a8c-4927-a1dc-f5caeab8f970 req-6795d3a3-3dd1-424c-88c4-154585a9a613 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:26.505533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-71da359c-5a8c-4927-a1dc-f5caeab8f970 req-6795d3a3-3dd1-424c-88c4-154585a9a613 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:26.584690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-71da359c-5a8c-4927-a1dc-f5caeab8f970 req-6795d3a3-3dd1-424c-88c4-154585a9a613 service nova] Creating event network-changed:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 15:56:26.597705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-71da359c-5a8c-4927-a1dc-f5caeab8f970 req-6795d3a3-3dd1-424c-88c4-154585a9a613 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212008 Dec 02 15:56:26.599283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 526/995] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:26 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:27.155000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:27.156827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:27.168403 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:27.168927 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:27.169814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:27.170712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:27.400588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:27.401867 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:27.412746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:27.413615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:27.414809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:27.415508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:27.557513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:27.581038 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:27.591473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:27.594849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-805e742d-76d2-4232-8d67-4e80d94f2c91 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.461872 Dec 02 15:56:27.607178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 470/996] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:27 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:27.739552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:27.756873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-75b53ab3-af15-49e3-b7fc-7988544e436a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.370502 Dec 02 15:56:27.760556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 527/997] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:27 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:28.631496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:28.632366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:28.641139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:28.645437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:28.646600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:28.647363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:28.805697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:28.806641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:28.816236 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:28.817057 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:28.818099 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:28.818910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:28.993941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:29.021202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:29.032193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:29.034291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-90d1c1b3-d77b-40b6-beca-44a0c1bbf4f8 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.422914 Dec 02 15:56:29.047729 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 471/998] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:28 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:29.155094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:29.167914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a8ae93e1-c0f1-4525-b0c8-87e74dc13ced tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.373108 Dec 02 15:56:29.174899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 528/999] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:28 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:30.066173 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:30.068149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:30.100529 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:30.101165 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:30.102136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:30.102709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:30.207215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:30.208045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:30.227578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:30.236757 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:30.237931 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:30.238562 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:30.475615 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:30.495131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:30.505412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:30.507368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-22cae3da-34a2-4fa0-a554-8f6e17ad70e4 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.454851 Dec 02 15:56:30.509370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 472/1000] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:30 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:30.544227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:30.560694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-15d282c8-06bf-407b-b2cd-01c206a6eb3a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.376827 Dec 02 15:56:30.561627 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 529/1001] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:30 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:31.535873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:31.536459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:31.545975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:31.547146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:31.548302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:31.548799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:31.585989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:31.617555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:31.617555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:31.617555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:31.617555 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:31.618005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:31.839503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:31.849854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a9d5e543-a5e7-466e-a8cf-fd2a97f942c1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.273356 Dec 02 15:56:31.850875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 530/1002] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:31 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:32.081137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:32.097544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:32.104241 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:32.105846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f9b65c72-68d7-468d-b4cc-73836aa43d15 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.579500 Dec 02 15:56:32.106373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 473/1003] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:31 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:32.283631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:32.284719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:32.293375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.293871 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.294713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.295213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.391921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e71e830b-c11f-412a-ba20-544bdb2f666c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.117877 Dec 02 15:56:32.392773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 531/1004] 10.222.0.101 () {58 vars in 1297 bytes} [Wed Dec 2 15:56:32 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:32.676096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:32.680279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:32.690013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.690013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.690013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.690611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.804368 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5f9eb6cb-a666-4a53-9693-5409c805ac52 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/b9e78b5f-e93c-428e-9ec8-47d34a50fd13" status: 200 len: 194 microversion: 2.1 time: 0.143249 Dec 02 15:56:32.805603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 474/1005] 10.222.0.101 () {58 vars in 1408 bytes} [Wed Dec 2 15:56:32 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/b9e78b5f-e93c-428e-9ec8-47d34a50fd13 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:32.834747 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:32.835711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:32.853631 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.855768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.856746 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.857696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.882946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:32.884126 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:32.896872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.898127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:32.899242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:32.899907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:33.240512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:33.254245 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c4807242-f9c4-497a-94d0-1066f9e8e18b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.386338 Dec 02 15:56:33.254983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 475/1006] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:32 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:33.267510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:33.268254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:33.276754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:33.277330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:33.278243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:33.278817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:33.389799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f3801289-03c3-45c7-b644-d1290decf11f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/b9e78b5f-e93c-428e-9ec8-47d34a50fd13" status: 202 len: 0 microversion: 2.1 time: 0.574517 Dec 02 15:56:33.394449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 532/1007] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:56:32 2020] DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/b9e78b5f-e93c-428e-9ec8-47d34a50fd13 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:56:33.548743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:33.566304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:33.575078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:33.576834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6498d394-c56c-47e5-80f9-31dbcddebb8e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1743 microversion: 2.20 time: 0.320153 Dec 02 15:56:33.578936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 476/1008] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:33 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1743 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:34.285523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:34.286300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:34.294978 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:34.295484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:34.297433 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:34.298017 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:34.556667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:34.573398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-276fa220-0ff4-49a0-aacf-5ed5877b8b6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.297729 Dec 02 15:56:34.574045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 533/1009] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:34 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:34.625335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:34.626625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:34.641816 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:34.642760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:34.644325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:34.645249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:35.069050 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:35.088873 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:35.098503 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:35.100617 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-825a4147-c363-42ec-a05a-41e445887451 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1725 microversion: 2.20 time: 0.496593 Dec 02 15:56:35.101239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 477/1010] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:34 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1725 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:35.597959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:35.598790 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:35.607560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:35.608090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:35.610061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:35.610579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:35.850678 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:35.851423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:35.863956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:35.864603 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:35.865575 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:35.866155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:35.886535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:35.896796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d6aad8d6-c659-4d93-9b01-c98f4b06a449 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.308905 Dec 02 15:56:35.900012 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 534/1011] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:35 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:35.945551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-96715324-3010-47d6-bc88-e35464263c71 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/bcfde3d1-13e8-44ee-a87b-cd26698681d8" status: 200 len: 194 microversion: 2.1 time: 0.112077 Dec 02 15:56:35.946213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 478/1012] 10.222.0.101 () {58 vars in 1408 bytes} [Wed Dec 2 15:56:35 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/bcfde3d1-13e8-44ee-a87b-cd26698681d8 => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:35.964172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:35.964711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:35.973793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:35.974300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:35.975136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:35.975694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:36.126999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:36.127708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:36.136056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:36.136576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:36.137401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:36.138090 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:36.346137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6320436a-4e50-483d-bc2f-52e1e4dd0525 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/bcfde3d1-13e8-44ee-a87b-cd26698681d8" status: 202 len: 0 microversion: 2.1 time: 0.391041 Dec 02 15:56:36.346881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 535/1013] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:56:35 2020] DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61/os-volume_attachments/bcfde3d1-13e8-44ee-a87b-cd26698681d8 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:56:36.401809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:36.418360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:36.426264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:36.427623 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af53a8f9-5f66-422e-9614-583a2076fe99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1725 microversion: 2.20 time: 0.310068 Dec 02 15:56:36.428416 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 479/1014] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:36 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:36.901742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-7c9fcdbe-37b6-4139-857c-7f8958bb45e4 req-90e83706-83f5-4fb1-afb8-926da858520a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "name": "network-vif-plugged", "status": "completed", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:36.909895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:36.909895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:36.919825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-7c9fcdbe-37b6-4139-857c-7f8958bb45e4 req-90e83706-83f5-4fb1-afb8-926da858520a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:36.920546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-7c9fcdbe-37b6-4139-857c-7f8958bb45e4 req-90e83706-83f5-4fb1-afb8-926da858520a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:36.924145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:36.924819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:36.933705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:36.934216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:36.935081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:36.935541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:36.940845 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-7c9fcdbe-37b6-4139-857c-7f8958bb45e4 req-90e83706-83f5-4fb1-afb8-926da858520a service nova] Creating event network-vif-plugged:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 15:56:36.946151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-7c9fcdbe-37b6-4139-857c-7f8958bb45e4 req-90e83706-83f5-4fb1-afb8-926da858520a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054662 Dec 02 15:56:36.947158 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 536/1015] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:36 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:37.197051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:37.207713 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d361b042-829b-4771-959d-ba9bae7ecbe3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.295759 Dec 02 15:56:37.208372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 480/1016] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:36 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:37.466010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:37.466693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:37.475399 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:37.475895 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:37.476762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:37.477252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:37.721857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:37.739301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:37.746513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:37.747771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-69921ea2-7804-4cfb-b160-2d2e5cb1f810 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1725 microversion: 2.20 time: 0.292353 Dec 02 15:56:37.748420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 537/1017] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:37 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:38.232544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:38.233345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:38.243252 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:38.243765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:38.244789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:38.245401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:38.488911 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:38.498022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d88eff2f-97dd-474a-9d46-3431bd606462 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1267 microversion: 2.1 time: 0.275509 Dec 02 15:56:38.506139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 481/1018] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:38 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:38.775658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:38.776367 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:38.785263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:38.785781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:38.786646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:38.787142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.048687 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:39.076006 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:39.083872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:39.084998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0833ca62-47f4-425d-ac46-05b4d6b69f6e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1725 microversion: 2.20 time: 0.319491 Dec 02 15:56:39.090514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 538/1019] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:38 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:39.194997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:39.195651 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:39.204947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.211817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.211817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.211817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.294875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:56:39.522785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:39.524332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:39.534046 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.540091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.540091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.540091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.567356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9432f378-38e8-4ca5-b945-ce500fb9a96c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 204 len: 0 microversion: 2.1 time: 0.383552 Dec 02 15:56:39.568078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 482/1020] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:56:39 2020] DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:56:39.586874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:39.587731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:39.597774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.598448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.599386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.599950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.795084 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:39.806525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8fb32ebb-03c9-4b48-ad5e-c0d5b29d45a1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1451 microversion: 2.1 time: 0.293407 Dec 02 15:56:39.807312 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 539/1021] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:39 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1451 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:39.836546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:39.837515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:39.845291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:39.848880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.849666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.851362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:39.852428 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:39.862415 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-35bdb653-98c4-43b9-883d-4d1d7a220527 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1677 microversion: 2.1 time: 0.286773 Dec 02 15:56:39.863357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 483/1022] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:39 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1677 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:40.118938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:40.119718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:40.120683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:40.130432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:40.130689 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:40.131539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:40.132219 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:40.132512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9df9fc71-2850-4233-acb0-0afa106f963b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1451 microversion: 2.1 time: 0.308025 Dec 02 15:56:40.144929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 540/1023] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:39 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1451 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:40.157151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-31aee8a6-3e8b-4d27-a084-d64e786f875f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'create', calling method: .version_select at 0x7f02707c70d0>, body: {"pool": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:40.451151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:40.467169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:40.474589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:40.475834 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-72573a97-6e79-49d1-95d0-9b8155628096 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1728 microversion: 2.20 time: 0.374078 Dec 02 15:56:40.476458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 484/1024] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:40 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1728 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:40.487353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-1006d262-3c52-421c-9a0f-19b98351f5e2 req-d2021221-2304-4214-824a-4e889c471d6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca", "name": "network-vif-unplugged", "status": "completed", "tag": "8520bf21-16f0-4a79-b561-5531577e5d0c"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:40.494530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:40.494530 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:40.505402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-1006d262-3c52-421c-9a0f-19b98351f5e2 req-d2021221-2304-4214-824a-4e889c471d6e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:40.506041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-1006d262-3c52-421c-9a0f-19b98351f5e2 req-d2021221-2304-4214-824a-4e889c471d6e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:40.525956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-1006d262-3c52-421c-9a0f-19b98351f5e2 req-d2021221-2304-4214-824a-4e889c471d6e service nova] Creating event network-vif-unplugged:8520bf21-16f0-4a79-b561-5531577e5d0c for instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca on hv-cinder-73761 Dec 02 15:56:40.532013 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-1006d262-3c52-421c-9a0f-19b98351f5e2 req-d2021221-2304-4214-824a-4e889c471d6e service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053530 Dec 02 15:56:40.532293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 485/1025] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:40 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:40.543695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fa8603a-fd20-4e8c-90c3-d28f12f91f69"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:40.545048 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:40.558065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:40.558762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:40.559847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:40.560463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:41.378148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-58c5c65a-f5fa-4dbc-b722-202b37d252bd tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.844427 Dec 02 15:56:41.378941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 486/1026] 10.222.0.101 () {62 vars in 1359 bytes} [Wed Dec 2 15:56:40 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/os-volume_attachments => generated 188 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 02 15:56:41.392711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:41.393386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:41.401768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:41.402563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:41.403112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:41.403598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:41.651362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:41.660812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-de8640d1-829d-4b66-9753-30d99073779a tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1677 microversion: 2.1 time: 0.277538 Dec 02 15:56:41.661425 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 487/1027] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:41 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1677 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:41.671945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:41.672543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:41.681009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:41.681475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:41.682323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:41.682811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:42.606021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fd1d0921-daa0-4272-a055-1d233df79746 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/os-volume_attachments/6fa8603a-fd20-4e8c-90c3-d28f12f91f69" status: 202 len: 0 microversion: 2.20 time: 0.943360 Dec 02 15:56:42.606670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 488/1028] 10.222.0.101 () {60 vars in 1452 bytes} [Wed Dec 2 15:56:41 2020] DELETE /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/os-volume_attachments/6fa8603a-fd20-4e8c-90c3-d28f12f91f69 => generated 0 bytes in 945 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:56:42.692702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:42.693392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:42.701352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:42.701857 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:42.703028 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:42.703231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.058474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-31aee8a6-3e8b-4d27-a084-d64e786f875f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.911439 Dec 02 15:56:43.059214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 541/1029] 10.222.0.101 () {60 vars in 1165 bytes} [Wed Dec 2 15:56:40 2020] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:56:43.070584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:43.071352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:43.082309 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.082966 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.083924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.084537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.154955 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:43.164398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dd616ece-44cb-4ba8-bc0d-603658324e8c tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1677 microversion: 2.1 time: 0.481337 Dec 02 15:56:43.165502 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 489/1030] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:42 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1677 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:43.176181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.3"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:43.177510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:43.185446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.185962 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.187430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.187945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.261514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Acquired lock "refresh_cache-88e84b35-1972-4148-a6f7-a4753c5c6f2d" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:56:43.322724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8ce6093f-b9ec-4026-b70b-019555a9b000 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action" status: 202 len: 0 microversion: 2.20 time: 0.262258 Dec 02 15:56:43.323693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 542/1031] 10.222.0.101 () {62 vars in 1314 bytes} [Wed Dec 2 15:56:43 2020] POST /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:56:43.337972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:43.338656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:43.347373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.347894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.348789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.349289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.602565 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:43.619636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:43.628095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:43.629774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2d2548b3-7760-4ef3-a537-f9e45e99318e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1676 microversion: 2.20 time: 0.301483 Dec 02 15:56:43.643298 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 543/1032] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:43 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1676 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:43.794498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-f0a92ad8-7a12-4abf-bdd8-d6a0dfd4ea57 req-87412747-6839-417c-ab6b-b815af8ad222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f6bca3-ecd8-46bf-b78b-11c4e89fdb61", "name": "network-vif-unplugged", "status": "completed", "tag": "3e83b8a1-a2d7-4b77-ba2c-33336ed53c88"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:43.802710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:43.802710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:43.813991 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-f0a92ad8-7a12-4abf-bdd8-d6a0dfd4ea57 req-87412747-6839-417c-ab6b-b815af8ad222 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:43.814601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-f0a92ad8-7a12-4abf-bdd8-d6a0dfd4ea57 req-87412747-6839-417c-ab6b-b815af8ad222 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:43.835914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-f0a92ad8-7a12-4abf-bdd8-d6a0dfd4ea57 req-87412747-6839-417c-ab6b-b815af8ad222 service nova] Creating event network-vif-unplugged:3e83b8a1-a2d7-4b77-ba2c-33336ed53c88 for instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 on hv-cinder-73761 Dec 02 15:56:43.841336 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-f0a92ad8-7a12-4abf-bdd8-d6a0dfd4ea57 req-87412747-6839-417c-ab6b-b815af8ad222 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056068 Dec 02 15:56:43.842539 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 544/1033] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:43 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:44.197719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:44.198508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:44.208347 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:44.208858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:44.209719 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:44.210209 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:44.458820 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:44.468993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f288625d-e37a-46f1-be96-f4e042faf99e tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1677 microversion: 2.1 time: 0.290434 Dec 02 15:56:44.469986 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 545/1034] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:44 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1677 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:44.656322 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:44.656896 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:44.665228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:44.665736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:44.666585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:44.667068 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:44.911083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:44.935419 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:44.943091 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:44.944381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ad2ae155-bcd3-4c19-8e0b-96b54ebcd6d1 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1678 microversion: 2.20 time: 0.297900 Dec 02 15:56:44.944985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 546/1035] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:44 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1678 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:45.493495 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:45.494169 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:45.503696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:45.504449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:45.505513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:45.506116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:45.770625 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:45.780969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fc6c7f6b-76b5-4e21-be83-6163b439dd4f tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1677 microversion: 2.1 time: 0.296643 Dec 02 15:56:45.781522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 547/1036] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:45 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1677 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:45.971491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:45.972188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:45.980315 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:45.980818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:45.981656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:45.982141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:46.237761 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:46.253180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:46.259901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:46.261146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-401cefd7-b984-410e-9fb0-234ec16eeb27 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1678 microversion: 2.20 time: 0.299921 Dec 02 15:56:46.261737 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 548/1037] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:45 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1678 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:46.806683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:46.807365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:46.817062 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:46.817563 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:46.818430 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:46.818918 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:47.064458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:47.074018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e5244507-7479-4700-a89c-4252c4733893 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1677 microversion: 2.1 time: 0.278489 Dec 02 15:56:47.074664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 549/1038] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:46 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 15:56:47.287999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:47.289214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:47.299383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:47.299383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:47.300877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:47.301622 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:47.410601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Building network info cache for instance {{(pid=94391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 15:56:47.630780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:47.647902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:47.655514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:47.656825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8ee5d263-1429-4d04-9952-4601ae77a6f9 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1678 microversion: 2.20 time: 0.379479 Dec 02 15:56:47.668063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 550/1039] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:47 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1678 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:47.668063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-0f1bcc31-1c88-493e-a43b-e8bbd27056c9 req-62e13754-690d-42f2-885c-6f8c1e586e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:47.675329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:47.675329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:47.688183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-0f1bcc31-1c88-493e-a43b-e8bbd27056c9 req-62e13754-690d-42f2-885c-6f8c1e586e4e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:47.688677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-0f1bcc31-1c88-493e-a43b-e8bbd27056c9 req-62e13754-690d-42f2-885c-6f8c1e586e4e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:47.709442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-0f1bcc31-1c88-493e-a43b-e8bbd27056c9 req-62e13754-690d-42f2-885c-6f8c1e586e4e service nova] Creating event network-changed:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 15:56:47.715089 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-0f1bcc31-1c88-493e-a43b-e8bbd27056c9 req-62e13754-690d-42f2-885c-6f8c1e586e4e service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056247 Dec 02 15:56:47.716087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 551/1040] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:47 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:48.114033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:48.116621 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:48.138402 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:48.148654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:48.149797 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:48.150311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:48.420578 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:48.435782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-947a9511-a75b-473a-9a6d-76bee58db121 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1609 microversion: 2.1 time: 0.345519 Dec 02 15:56:48.447291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 552/1041] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:48 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1609 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:48.687620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:48.690202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:48.701577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:48.703205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:48.704998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:48.705755 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:49.223825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:49.254100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:49.275582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:49.293137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-15945e3b-24b3-46b2-a059-1ef97d6c4b07 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.617971 Dec 02 15:56:49.293904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 553/1042] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:48 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:49.461901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:49.462507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:49.473858 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Updating instance_info_cache with network_info: [{"id": "4e88c508-63bd-4782-ab84-478ed9ae3bb4", "address": "fa:16:3e:f8:2d:77", "network": {"id": "b49751da-eb0e-4ecb-880c-88dd1ff589c9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1860306437-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "92c709d41db94ec88054f3a048762c37", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap4e88c508-63", "ovs_interfaceid": "4e88c508-63bd-4782-ab84-478ed9ae3bb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 15:56:49.492541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:49.493183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:49.494097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:49.494598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:49.512994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Releasing lock "refresh_cache-88e84b35-1972-4148-a6f7-a4753c5c6f2d" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:56:49.514054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b8e1277a-88f6-468f-9ee0-43e1167a898b tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d/action" status: 202 len: 0 microversion: 2.1 time: 6.348035 Dec 02 15:56:49.515401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 490/1043] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:56:43 2020] POST /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d/action => generated 0 bytes in 6349 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 02 15:56:49.591074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:49.591887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:49.593218 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lazy-loading 'fault' on Instance uuid 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:56:49.681754 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b34c14f9d8a4a1d885f449b18e7bf5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd15c18c1994d418ad257735d95e8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:49.695664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-daf0e52e-294f-49d9-a59d-a211d1a54074 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 200 len: 1331 microversion: 2.1 time: 0.244447 Dec 02 15:56:49.706656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 554/1044] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:49 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 1331 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:56:49.874693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-701b0a79-e115-49ce-a509-1131ad2a6925 req-b3371ea7-f6dd-4b84-9af1-9704e4f6733f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f6bca3-ecd8-46bf-b78b-11c4e89fdb61", "name": "network-vif-deleted", "tag": "3e83b8a1-a2d7-4b77-ba2c-33336ed53c88"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:56:49.884624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:56:49.884624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:56:49.897663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-701b0a79-e115-49ce-a509-1131ad2a6925 req-b3371ea7-f6dd-4b84-9af1-9704e4f6733f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:49.898597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-701b0a79-e115-49ce-a509-1131ad2a6925 req-b3371ea7-f6dd-4b84-9af1-9704e4f6733f service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:49.941263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-701b0a79-e115-49ce-a509-1131ad2a6925 req-b3371ea7-f6dd-4b84-9af1-9704e4f6733f service nova] Creating event network-vif-deleted:3e83b8a1-a2d7-4b77-ba2c-33336ed53c88 for instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 on hv-cinder-73761 Dec 02 15:56:49.948735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-701b0a79-e115-49ce-a509-1131ad2a6925 req-b3371ea7-f6dd-4b84-9af1-9704e4f6733f service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086468 Dec 02 15:56:49.955071 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 491/1045] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:56:49 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:56:50.366824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:50.376673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:50.387093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:50.387691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:50.388779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:50.389470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:50.700708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:50.725319 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:50.732036 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:50.734145 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:50.737345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:50.738736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4f18f4dd-4895-426e-95bc-8eca2094afc2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.428118 Dec 02 15:56:50.739248 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 555/1046] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:50 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:50.743910 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:50.744476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:50.745340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:50.745828 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:50.807362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] HTTP exception thrown: Instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 could not be found. Dec 02 15:56:50.808335 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Returning 404 to user: Instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:56:50.809602 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-36406a67-e5bd-4b03-8a0f-8d9c2455827b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 404 len: 111 microversion: 2.1 time: 0.097607 Dec 02 15:56:50.810412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 492/1047] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:50 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 02 15:56:50.839498 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ecedee65-90dc-4e94-8350-2be1a81b74da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '.version_select at 0x7f02752d1400>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:50.931318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ecedee65-90dc-4e94-8350-2be1a81b74da tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398129464" status: 202 len: 0 microversion: 2.1 time: 0.112673 Dec 02 15:56:50.932392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 556/1048] 10.222.0.101 () {58 vars in 1216 bytes} [Wed Dec 2 15:56:50 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398129464 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:56:51.787113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:51.789707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:51.803945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:51.805224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:51.806264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:51.806866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:52.133731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:52.155756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:52.179144 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:52.180478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fefffff6-e0fc-4cd4-bb47-9a09fbeaf055 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.414561 Dec 02 15:56:52.181104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 493/1049] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:51 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:53.237517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:53.238275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:53.250117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:53.250916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:53.251964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:53.252479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:53.492176 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:53.514170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:53.522373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:53.523771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9f5c95be-f58c-4a47-aedd-aa20177cdd30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.307838 Dec 02 15:56:53.524454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 557/1050] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:53 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:54.549730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:54.550398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:54.559674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:54.560250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:54.561083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:54.562141 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:54.798833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:54.815581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:54.822499 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:54.823763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b366a36a-999d-4a77-8d7d-11ddbac9fb17 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.283874 Dec 02 15:56:54.824390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 494/1051] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:54 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:55.278149 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:55.279283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:55.290868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:55.292074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:55.293371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:55.294138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:55.353263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] HTTP exception thrown: Instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 could not be found. Dec 02 15:56:55.354309 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Returning 404 to user: Instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:56:55.355409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3cfffa72-76d1-4ca6-bccf-b183ed07fab5 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 404 len: 111 microversion: 2.1 time: 0.088885 Dec 02 15:56:55.360129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 558/1052] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:56:55 2020] DELETE /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:56:55.370323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:55.370989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:55.379437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:55.379939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:55.380806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:55.381289 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:55.441329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] HTTP exception thrown: Instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 could not be found. Dec 02 15:56:55.441930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Returning 404 to user: Instance 35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:56:55.442916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0c1a5e3b-e576-4c5c-b1fd-bcf8b8d9c714 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61" status: 404 len: 111 microversion: 2.1 time: 0.081826 Dec 02 15:56:55.443541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 495/1053] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:55 2020] GET /compute/v2.1/servers/35f6bca3-ecd8-46bf-b78b-11c4e89fdb61 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 02 15:56:55.863724 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:55.864488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:55.872979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:55.874136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:55.875254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:55.875768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:56.154441 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:56.184164 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:56.198626 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:56.200864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fa74a53a-7441-4f21-920c-b378ca0c846e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.361279 Dec 02 15:56:56.203339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 559/1054] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:55 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:56:56.799360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:56.799909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:56.807843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:56.808395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:56.809380 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:56.809808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:56.865222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] HTTP exception thrown: Instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 could not be found. Dec 02 15:56:56.865984 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Returning 404 to user: Instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:56:56.866758 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-98519834-e486-49e5-9878-16432f487568 tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "DELETE /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 404 len: 111 microversion: 2.1 time: 0.077454 Dec 02 15:56:56.867374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 496/1055] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:56:56 2020] DELETE /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:56:56.882609 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:56.883306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] [instance: 86b113cf-44c3-41ee-abfd-329c10e9e8e7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:56.892079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:56.892580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:56.893474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:56.893990 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:56.953363 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] HTTP exception thrown: Instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 could not be found. Dec 02 15:56:56.954041 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] Returning 404 to user: Instance 86b113cf-44c3-41ee-abfd-329c10e9e8e7 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:56:56.954964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a8fb67a7-548d-441e-b1e3-e5eba257dc8b tempest-AttachVolumeTestJSON-1454544481 tempest-AttachVolumeTestJSON-1454544481] 10.222.0.101 "GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7" status: 404 len: 111 microversion: 2.1 time: 0.082956 Dec 02 15:56:56.955852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 560/1056] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:56:56 2020] GET /compute/v2.1/servers/86b113cf-44c3-41ee-abfd-329c10e9e8e7 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:56:57.238909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:57.239953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:57.249819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:57.250591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:57.255793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:57.255793 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:57.519863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:57.536733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:57.543684 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:57.544989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-852606d6-baf8-4147-a75c-b65ed4828e38 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.315891 Dec 02 15:56:57.545972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 497/1057] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:57 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:56:58.573162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:56:58.573926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:56:58.590716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:58.591500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:58.593095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:56:58.593694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:56:59.320026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:59.353392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:59.361520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:56:59.362929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1b941543-18ae-4c36-80b0-2a43a5eb3997 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.799301 Dec 02 15:56:59.363863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 561/1058] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:56:58 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:57:00.398598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:00.400168 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:00.418353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:00.419455 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:00.421933 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:00.422899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:00.745894 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:00.762131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:00.769592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:00.770837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1b8128c4-ae0c-453e-be6f-e8bbdebe5f30 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.384550 Dec 02 15:57:00.771427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 498/1059] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:00 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:01.813375 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:01.814620 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:01.829543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:01.830095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:01.831350 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:01.832125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:02.561637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 15:57:02.561977 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 15:57:02 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 15:57:02.584643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:02.607733 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:02.614514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:02.616339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-978daec4-19b6-4c45-bf6e-3b6fa5095e7e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.827390 Dec 02 15:57:02.617588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 562/1060] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:01 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:03.655596 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:03.656332 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:03.664926 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:03.665435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:03.666301 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:03.666795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:04.027201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:04.054311 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:04.064817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:04.066869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3413f5dc-42ee-43d1-a53e-778fcec0a86f tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.421030 Dec 02 15:57:04.067812 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 499/1061] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:03 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:57:05.125393 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:05.126654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:05.142369 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:05.143162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:05.144696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:05.145465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:06.017586 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:06.040405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:06.050549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:06.052114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b5533aec-f3c1-4bab-9e8f-21d4de8f9209 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.945497 Dec 02 15:57:06.052732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 563/1062] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:05 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:06.741921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ba2cbe57-bb8c-48b7-abe4-e8c33e17eb99 req-42181f0e-5aa4-444e-8785-5861cc24d45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca", "name": "network-vif-plugged", "status": "completed", "tag": "8520bf21-16f0-4a79-b561-5531577e5d0c"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:06.750357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:57:06.750357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:57:06.759491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ba2cbe57-bb8c-48b7-abe4-e8c33e17eb99 req-42181f0e-5aa4-444e-8785-5861cc24d45a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:06.760016 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ba2cbe57-bb8c-48b7-abe4-e8c33e17eb99 req-42181f0e-5aa4-444e-8785-5861cc24d45a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:06.780391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ba2cbe57-bb8c-48b7-abe4-e8c33e17eb99 req-42181f0e-5aa4-444e-8785-5861cc24d45a service nova] Creating event network-vif-plugged:8520bf21-16f0-4a79-b561-5531577e5d0c for instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca on hv-cinder-73761 Dec 02 15:57:06.785699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ba2cbe57-bb8c-48b7-abe4-e8c33e17eb99 req-42181f0e-5aa4-444e-8785-5861cc24d45a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054788 Dec 02 15:57:06.786388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 500/1063] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:57:06 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:57:07.081109 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:07.081767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:07.090692 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:07.091584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:07.093087 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:07.093803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:07.463378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:07.493771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:07.508879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:07.509324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e087759c-8127-43f1-8f87-b675d392971b tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.438702 Dec 02 15:57:07.510242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 564/1064] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:07 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:08.542618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:08.543946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:08.554579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:08.555108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:08.556045 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:08.556571 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:08.868171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:08.903011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:08.919671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:08.922749 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f75dbf98-6581-4189-9546-055300f0d87a tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.394696 Dec 02 15:57:08.923877 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 501/1065] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:08 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:09.958589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:09.959744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:09.979270 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:09.987520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:09.987520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:09.987520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:10.319806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:10.364232 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:10.372148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:10.374249 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-04ab2122-537d-4aeb-a3e4-115465e5bb61 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1734 microversion: 2.20 time: 0.433946 Dec 02 15:57:10.375474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 565/1066] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:09 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1734 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:11.404809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:11.406412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:11.416848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:11.417536 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:11.418708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:11.419361 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:11.738993 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:11.754854 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:11.761796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:11.763082 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a9a03a3e-4c12-4387-b676-4b67d69f25c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1721 microversion: 2.20 time: 0.370825 Dec 02 15:57:11.764491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 502/1067] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:11 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1721 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:57:16.245745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1230431403"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:16.246372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:16.256454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:16.257118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:16.258095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:16.258708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:16.572576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.network.security_group_api [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Removing security group b67ed5ca-6e5b-430f-83f7-8c6d94aedad4 from port 257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b Dec 02 15:57:17.453251 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-782e8e2f-cda7-4230-90bc-7437dbb983cb tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action" status: 202 len: 0 microversion: 2.1 time: 1.216872 Dec 02 15:57:17.455316 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 566/1068] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:57:16 2020] POST /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/action => generated 0 bytes in 1220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:57:17.467945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-ea5986ca-8bce-4e05-a4a6-a1bcef434cd9 req-7898f0fa-d568-4f38-b2a5-ddb29a782df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:17.475482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:57:17.475482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:57:17.487021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b672dde8-1c5c-47bd-9dc2-99c902b08611 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '.version_select at 0x7f02710798c8>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:17.489000 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ea5986ca-8bce-4e05-a4a6-a1bcef434cd9 req-7898f0fa-d568-4f38-b2a5-ddb29a782df3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:17.489846 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-ea5986ca-8bce-4e05-a4a6-a1bcef434cd9 req-7898f0fa-d568-4f38-b2a5-ddb29a782df3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:17.534127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-ea5986ca-8bce-4e05-a4a6-a1bcef434cd9 req-7898f0fa-d568-4f38-b2a5-ddb29a782df3 service nova] Creating event network-changed:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:57:17.545362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-ea5986ca-8bce-4e05-a4a6-a1bcef434cd9 req-7898f0fa-d568-4f38-b2a5-ddb29a782df3 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087017 Dec 02 15:57:17.546410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 503/1069] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:57:17 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:57:18.609150 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b672dde8-1c5c-47bd-9dc2-99c902b08611 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "DELETE /compute/v2.1/os-security-groups/b67ed5ca-6e5b-430f-83f7-8c6d94aedad4" status: 202 len: 0 microversion: 2.1 time: 1.146060 Dec 02 15:57:18.611328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 567/1070] 10.222.0.101 () {58 vars in 1267 bytes} [Wed Dec 2 15:57:17 2020] DELETE /compute/v2.1/os-security-groups/b67ed5ca-6e5b-430f-83f7-8c6d94aedad4 => generated 0 bytes in 1150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:57:18.636263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '.version_select at 0x7f0263c44b70>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:19.283177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:19.298032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:19.304447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:19.304447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:19.304447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:19.378190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Acquired lock "refresh_cache-f24895d2-03f9-430a-ad1f-6aa8f33bbb39" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:57:21.861396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Building network info cache for instance {{(pid=94391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 15:57:21.887572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-5c20f56b-4197-492b-8648-93f9b59aaf14 req-f72f2d54-1ab3-440c-9e45-58c3cc60a8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:21.903193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:57:21.903193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:57:21.918742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5c20f56b-4197-492b-8648-93f9b59aaf14 req-f72f2d54-1ab3-440c-9e45-58c3cc60a8c7 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:21.920449 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-5c20f56b-4197-492b-8648-93f9b59aaf14 req-f72f2d54-1ab3-440c-9e45-58c3cc60a8c7 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:21.945377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-5c20f56b-4197-492b-8648-93f9b59aaf14 req-f72f2d54-1ab3-440c-9e45-58c3cc60a8c7 service nova] Creating event network-changed:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:57:21.950769 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-5c20f56b-4197-492b-8648-93f9b59aaf14 req-f72f2d54-1ab3-440c-9e45-58c3cc60a8c7 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077781 Dec 02 15:57:21.951409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 568/1071] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:57:21 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:57:22.850928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Updating instance_info_cache with network_info: [{"id": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b", "address": "fa:16:3e:7e:a1:ad", "network": {"id": "08fcbd27-70ce-4049-b75e-7a1e77449ef3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1671788462-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "b3960161fdaa40adbf4ef023f92ffd5d", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap257af1d4-f3", "ovs_interfaceid": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 15:57:22.916782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Releasing lock "refresh_cache-f24895d2-03f9-430a-ad1f-6aa8f33bbb39" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:57:22.918658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f3e46ac1-1101-49ca-a990-3a3063b4b88b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "DELETE /compute/v2.1/os-floating-ips/81c0ad74-b40f-4d64-8224-db9eb90eb32f" status: 202 len: 0 microversion: 2.1 time: 4.300762 Dec 02 15:57:22.920199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 504/1072] 10.222.0.101 () {58 vars in 1258 bytes} [Wed Dec 2 15:57:18 2020] DELETE /compute/v2.1/os-floating-ips/81c0ad74-b40f-4d64-8224-db9eb90eb32f => generated 0 bytes in 4304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:57:22.937924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:22.938875 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:22.948381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:22.948861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:22.949913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:22.950377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:23.399950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-64247325-a4e6-4150-bec3-2628f23c2797 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "DELETE /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/os-volume_attachments/a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be" status: 202 len: 0 microversion: 2.1 time: 0.474085 Dec 02 15:57:23.400643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 569/1073] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:57:22 2020] DELETE /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/os-volume_attachments/a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:57:25.900827 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:25.901473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:25.910696 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:25.911200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:25.912263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:25.912756 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:26.099137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] HTTP exception thrown: Instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 is not attached to volume a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be Dec 02 15:57:26.099807 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Returning 404 to user: Instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 is not attached to volume a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:26.100751 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1543cc83-8074-4582-8bd2-7bf9368a54d3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "DELETE /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/os-volume_attachments/a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be" status: 404 len: 154 microversion: 2.1 time: 0.209971 Dec 02 15:57:26.101370 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 505/1074] 10.222.0.101 () {58 vars in 1411 bytes} [Wed Dec 2 15:57:25 2020] DELETE /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39/os-volume_attachments/a9cbe962-5aef-48b8-b69e-8bbb5c1cd2be => generated 154 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 02 15:57:27.491656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:27.492377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:27.502140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:27.502648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:27.503500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:27.504011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:27.579785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:57:27.812544 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3aff30ab-89cd-4921-9c28-62eebf63d3a3 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "DELETE /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 204 len: 0 microversion: 2.1 time: 0.330926 Dec 02 15:57:27.813203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 570/1075] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:57:27 2020] DELETE /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 15:57:27.838584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:27.839263 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:27.848961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:27.849592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:27.850476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:27.851039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:28.156641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:28.165907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0ca53bf0-288f-42a7-bc06-38f0970f7077 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1558 microversion: 2.1 time: 0.337088 Dec 02 15:57:28.166527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 506/1076] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:27 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:57:29.191604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:29.193239 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:29.202244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:29.202892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:29.203764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:29.205258 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:29.493992 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:29.503221 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0e3feb92-8cbd-44e2-adf9-2d256b5e046c tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1558 microversion: 2.1 time: 0.322169 Dec 02 15:57:29.504027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 571/1077] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:29 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1558 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:57:30.529587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:30.530269 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:30.539106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:30.539619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:30.540508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:30.540977 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:30.541215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-b3f35131-b8ee-4856-9ceb-06d45dc827dd req-7a2490d5-517c-4559-87ff-b4d6464ecdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "name": "network-vif-unplugged", "status": "completed", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:30.552015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:57:30.552015 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:57:30.562787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b3f35131-b8ee-4856-9ceb-06d45dc827dd req-7a2490d5-517c-4559-87ff-b4d6464ecdc2 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:30.563293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-b3f35131-b8ee-4856-9ceb-06d45dc827dd req-7a2490d5-517c-4559-87ff-b4d6464ecdc2 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:30.589819 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-b3f35131-b8ee-4856-9ceb-06d45dc827dd req-7a2490d5-517c-4559-87ff-b4d6464ecdc2 service nova] Creating event network-vif-unplugged:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:57:30.595693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-b3f35131-b8ee-4856-9ceb-06d45dc827dd req-7a2490d5-517c-4559-87ff-b4d6464ecdc2 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069382 Dec 02 15:57:30.596585 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 572/1078] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:57:30 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:57:30.792039 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:30.801739 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-168a63ef-702d-44d8-9f69-a986bf0e3de0 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1558 microversion: 2.1 time: 0.283713 Dec 02 15:57:30.802360 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 507/1079] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:30 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1558 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:57:31.828479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:31.830074 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:31.838708 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:31.839306 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:31.840127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:31.840643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:32.048413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '821269dc140c4bffb56704768960364b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3960161fdaa40adbf4ef023f92ffd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:32.067924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-62887ccc-775b-4a0f-82e4-01a148ccddd2 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 200 len: 1516 microversion: 2.1 time: 0.249950 Dec 02 15:57:32.069262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 573/1080] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:31 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:57:32.262657 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-51ae9893-cc70-4c75-a15a-eecfefae788c req-b0995203-bfec-4ea2-ada2-954341e86ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24895d2-03f9-430a-ad1f-6aa8f33bbb39", "name": "network-vif-deleted", "tag": "257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:32.274579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:57:32.274579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:57:32.284523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-51ae9893-cc70-4c75-a15a-eecfefae788c req-b0995203-bfec-4ea2-ada2-954341e86ba4 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:32.285199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-51ae9893-cc70-4c75-a15a-eecfefae788c req-b0995203-bfec-4ea2-ada2-954341e86ba4 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:32.304718 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-51ae9893-cc70-4c75-a15a-eecfefae788c req-b0995203-bfec-4ea2-ada2-954341e86ba4 service nova] Creating event network-vif-deleted:257af1d4-f390-4a4b-9a71-8ccbd1ec4b4b for instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 on hv-cinder-73761 Dec 02 15:57:32.311665 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-51ae9893-cc70-4c75-a15a-eecfefae788c req-b0995203-bfec-4ea2-ada2-954341e86ba4 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070410 Dec 02 15:57:32.312517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 508/1081] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:57:32 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:57:33.099922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:33.100512 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] [instance: f24895d2-03f9-430a-ad1f-6aa8f33bbb39] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:33.109597 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:33.110219 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:33.111146 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:33.111781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:33.245806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] HTTP exception thrown: Instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 could not be found. Dec 02 15:57:33.246476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Returning 404 to user: Instance f24895d2-03f9-430a-ad1f-6aa8f33bbb39 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:33.247474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9c2b6c84-b012-41ab-b31a-fd08f3d10b1b tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39" status: 404 len: 111 microversion: 2.1 time: 0.157463 Dec 02 15:57:33.248093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 574/1082] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:33 2020] GET /compute/v2.1/servers/f24895d2-03f9-430a-ad1f-6aa8f33bbb39 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:57:33.263377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6552b2ed-0ad6-4888-bbaa-30912ab08a98 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] Calling method '.version_select at 0x7f0263c44620>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:33.321184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6552b2ed-0ad6-4888-bbaa-30912ab08a98 tempest-TestMinimumBasicScenario-371425513 tempest-TestMinimumBasicScenario-371425513] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1001924322" status: 202 len: 0 microversion: 2.1 time: 0.067867 Dec 02 15:57:33.321825 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 509/1083] 10.222.0.101 () {58 vars in 1267 bytes} [Wed Dec 2 15:57:33 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1001924322 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:57:44.934138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:44.935431 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:44.944051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:44.944864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:44.946528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:44.947212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:45.026528 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 15:57:45.366925 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0644312f-f8d0-4a09-b795-2f47b97deabc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 204 len: 0 microversion: 2.20 time: 0.441970 Dec 02 15:57:45.368065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 575/1084] 10.222.0.101 () {60 vars in 1275 bytes} [Wed Dec 2 15:57:44 2020] DELETE /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 02 15:57:45.393189 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:45.394112 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:45.411579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:45.412378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:45.413334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:45.413970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:45.690162 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:45.706281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:45.713174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:45.714414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d7d0763c-143c-413b-ad84-666a84bc14b2 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.338753 Dec 02 15:57:45.714979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 510/1085] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:45 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:46.742736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:46.743551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:46.752714 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:46.753345 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:46.754192 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:46.754680 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:47.365987 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:47.384712 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:47.393123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:47.394395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-cb5847d8-c4aa-42ba-af03-afbc9a8f7ac3 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1727 microversion: 2.20 time: 0.663293 Dec 02 15:57:47.394974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 576/1086] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:46 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1727 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:48.436395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:48.439479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:48.456114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:48.457436 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:48.459999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:48.461278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:48.666297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:48.690493 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:48.698878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:48.700919 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-044f8bbe-3c83-4f48-b225-728e3ee94f99 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1660 microversion: 2.20 time: 0.280582 Dec 02 15:57:48.701514 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 511/1087] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:48 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1660 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 02 15:57:49.288554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-bd35933d-0de5-4454-b0dd-bf746db7f0c8 req-f89fb9a3-56bc-4e29-8d68-e55aba61b753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca", "name": "network-vif-deleted", "tag": "8520bf21-16f0-4a79-b561-5531577e5d0c"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:57:49.304480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:57:49.304480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:57:49.321644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-bd35933d-0de5-4454-b0dd-bf746db7f0c8 req-f89fb9a3-56bc-4e29-8d68-e55aba61b753 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:49.322525 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-bd35933d-0de5-4454-b0dd-bf746db7f0c8 req-f89fb9a3-56bc-4e29-8d68-e55aba61b753 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:49.357694 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-bd35933d-0de5-4454-b0dd-bf746db7f0c8 req-f89fb9a3-56bc-4e29-8d68-e55aba61b753 service nova] Creating event network-vif-deleted:8520bf21-16f0-4a79-b561-5531577e5d0c for instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca on hv-cinder-73761 Dec 02 15:57:49.366364 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-bd35933d-0de5-4454-b0dd-bf746db7f0c8 req-f89fb9a3-56bc-4e29-8d68-e55aba61b753 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097657 Dec 02 15:57:49.367490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 577/1088] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:57:49 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:57:49.752297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:49.753633 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:49.770465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:49.771400 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:49.773020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:49.773952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:49.875679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:49.876161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:49.876643 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lazy-loading 'fault' on Instance uuid e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca {{(pid=94391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:57:49.975202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:50.011802 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:50.029338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7231feb43e2144b890005197f88f34ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db296e2b87e34627b69487c0870d6fb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:57:50.032222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-6e096386-3021-48c7-8cfc-e3f7f41bec62 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 200 len: 1375 microversion: 2.20 time: 0.301883 Dec 02 15:57:50.033795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 512/1089] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:49 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 1375 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 02 15:57:51.069695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:51.070473 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:51.088448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:51.088974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:51.089869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:51.090928 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:51.168787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] HTTP exception thrown: Instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca could not be found. Dec 02 15:57:51.170288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Returning 404 to user: Instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:51.171292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-50245620-bddd-429e-b636-e8393f204d2e tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 404 len: 111 microversion: 2.20 time: 0.112316 Dec 02 15:57:51.172094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 578/1090] 10.222.0.101 () {60 vars in 1272 bytes} [Wed Dec 2 15:57:51 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 02 15:57:51.188003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3bb6b74c-7d0c-4146-bc27-45e14c6bfcca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '.version_select at 0x7f0263c44e18>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:51.247279 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3bb6b74c-7d0c-4146-bc27-45e14c6bfcca tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837807908" status: 204 len: 0 microversion: 2.20 time: 0.068696 Dec 02 15:57:51.247929 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 513/1091] 10.222.0.101 () {60 vars in 1254 bytes} [Wed Dec 2 15:57:51 2020] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837807908 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 02 15:57:57.641073 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:57.641788 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:57.650187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:57.650707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:57.651564 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:57.652124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:57.711207 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] HTTP exception thrown: Instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca could not be found. Dec 02 15:57:57.712085 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Returning 404 to user: Instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:57.713535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2dc776d8-0a0d-4997-ad5d-29127eef2a9c tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 404 len: 111 microversion: 2.1 time: 0.082590 Dec 02 15:57:57.714492 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 579/1092] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:57:57 2020] DELETE /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:57:57.731213 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:57.731899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:57.741423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:57.741934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:57.742795 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:57.743291 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:57.798181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] HTTP exception thrown: Instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca could not be found. Dec 02 15:57:57.798853 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Returning 404 to user: Instance e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:57.799779 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-86f96bda-313b-47cb-bba0-f0cae9f4a22d tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca" status: 404 len: 111 microversion: 2.1 time: 0.080117 Dec 02 15:57:57.800448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 514/1093] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:57 2020] GET /compute/v2.1/servers/e9ed4ad9-27ab-43f9-a4ec-97abe31b06ca => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:57:59.209616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:59.210230 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:59.218972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:59.219469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:59.220629 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:59.221114 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:59.284874 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] HTTP exception thrown: Instance a5112b52-9227-41cf-a36c-19e97dd4222c could not be found. Dec 02 15:57:59.285693 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Returning 404 to user: Instance a5112b52-9227-41cf-a36c-19e97dd4222c could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:59.286843 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-59b43c47-c49b-4f77-a51a-0ffb803ba6dc tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "DELETE /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 404 len: 111 microversion: 2.1 time: 0.087308 Dec 02 15:57:59.287466 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 580/1094] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 15:57:59 2020] DELETE /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:57:59.302899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:57:59.303824 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] [instance: a5112b52-9227-41cf-a36c-19e97dd4222c] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:57:59.313866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:59.314377 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:59.315337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:57:59.315907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:57:59.384541 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] HTTP exception thrown: Instance a5112b52-9227-41cf-a36c-19e97dd4222c could not be found. Dec 02 15:57:59.385216 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] Returning 404 to user: Instance a5112b52-9227-41cf-a36c-19e97dd4222c could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:57:59.386175 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ce9299c5-13be-4188-8c45-de2fb801b6c0 tempest-AttachVolumeShelveTestJSON-1153683862 tempest-AttachVolumeShelveTestJSON-1153683862] 10.222.0.101 "GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c" status: 404 len: 111 microversion: 2.1 time: 0.094022 Dec 02 15:57:59.386887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 515/1095] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:57:59 2020] GET /compute/v2.1/servers/a5112b52-9227-41cf-a36c-19e97dd4222c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:58:11.951187 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0452e4d7-ee17-462d-b7cf-810038b3eba0 tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Action: 'create', calling method: .version_select at 0x7f02710b7268>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-616583838", "metadata": {"Type": "work"}}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:12.782366 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0452e4d7-ee17-462d-b7cf-810038b3eba0 tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.028918 Dec 02 15:58:12.783106 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 581/1096] 10.222.0.101 () {60 vars in 1151 bytes} [Wed Dec 2 15:58:11 2020] POST /compute/v2.1/os-volumes => generated 352 bytes in 1031 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Dec 02 15:58:12.801472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b79dfc43-01d1-4dac-8bf3-bff3733446fe tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Calling method '.version_select at 0x7f0263c44158>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:13.012647 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b79dfc43-01d1-4dac-8bf3-bff3733446fe tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0" status: 200 len: 352 microversion: 2.1 time: 0.220925 Dec 02 15:58:13.016206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 516/1097] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:58:12 2020] GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:58:13.787022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-960547396", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-274750580", "security_groups": [{"name": "tempest-TestVolumeBootPattern-2048584045"}], "block_device_mapping_v2": [{"uuid": "386bdd5f-9d4f-41c3-ab4f-328c890ec418", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb"}]}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:14.006517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] validate_networks() for [('fb4a3f3f-f009-42fb-af5a-e60d7446ffbb', None, None, None)] {{(pid=94390) validate_networks /opt/stack/nova/nova/network/neutron.py:2341}} Dec 02 15:58:14.036864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-63e93045-8335-411e-ae66-ad7fc620d775 tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Calling method '.version_select at 0x7f0263c44b70>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:14.188340 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-63e93045-8335-411e-ae66-ad7fc620d775 tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0" status: 200 len: 353 microversion: 2.1 time: 0.161598 Dec 02 15:58:14.189104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 517/1098] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:58:14 2020] GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:58:14.212299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e5d3e184-87cc-46e3-b310-63a6396e0d50 tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Calling method '.version_select at 0x7f0263c44620>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:14.330960 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e5d3e184-87cc-46e3-b310-63a6396e0d50 tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0" status: 200 len: 353 microversion: 2.1 time: 0.127934 Dec 02 15:58:14.332220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 518/1099] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:58:14 2020] GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:58:14.357770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4b9abe4e-f149-4940-b527-7d7cbeea90fb tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Calling method '.version_select at 0x7f0263c06c80>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:14.555946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4b9abe4e-f149-4940-b527-7d7cbeea90fb tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "DELETE /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0" status: 202 len: 0 microversion: 2.1 time: 0.210598 Dec 02 15:58:14.556809 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 519/1100] 10.222.0.101 () {58 vars in 1243 bytes} [Wed Dec 2 15:58:14 2020] DELETE /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:58:14.571283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-47e821a9-b6b6-4799-8b83-03a9d4b6c78d tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Calling method '.version_select at 0x7f0263c440d0>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:14.682771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-47e821a9-b6b6-4799-8b83-03a9d4b6c78d tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0" status: 200 len: 352 microversion: 2.1 time: 0.120655 Dec 02 15:58:14.683474 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 520/1101] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:58:14 2020] GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:58:14.873412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Flavor limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Dec 02 15:58:14.873938 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Image limits 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Dec 02 15:58:14.874485 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Flavor pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Dec 02 15:58:14.874949 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Image pref 0:0:0 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Dec 02 15:58:14.875410 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.virt.hardware [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=94390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:432}} Dec 02 15:58:14.885325 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:14.885865 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:14.886740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:14.887231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:14.908717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for project e84bacbd36bc4a75898431f75ffae141. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:388}} Dec 02 15:58:14.913664 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.quota [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Getting quotas for user d269a2a6f71e40538a8b7b7a199ec693 and project e84bacbd36bc4a75898431f75ffae141. Resources: {'ram', 'cores', 'instances'} {{(pid=94390) _get_quotas /opt/stack/nova/nova/quota.py:380}} Dec 02 15:58:15.051592 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Going to run 1 instances... {{(pid=94390) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Dec 02 15:58:15.056546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='386bdd5f-9d4f-41c3-ab4f-328c890ec418',volume_size=None,volume_type=None)] {{(pid=94390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1662}} Dec 02 15:58:15.438080 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-92253410-5c17-4786-90bd-33fda8089564 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/servers" status: 202 len: 415 microversion: 2.1 time: 1.660829 Dec 02 15:58:15.439709 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 582/1102] 10.222.0.101 () {60 vars in 1142 bytes} [Wed Dec 2 15:58:13 2020] POST /compute/v2.1/servers => generated 415 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 02 15:58:15.467864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3430715d-a087-4701-a469-dc79f9bc8499 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:15.468745 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3430715d-a087-4701-a469-dc79f9bc8499 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:15.573240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3430715d-a087-4701-a469-dc79f9bc8499 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:15.582768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3430715d-a087-4701-a469-dc79f9bc8499 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1096 microversion: 2.1 time: 0.132920 Dec 02 15:58:15.584418 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 521/1103] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:15 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1096 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:15.704538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8cc07575-3796-4183-8a22-dbc29bdf9c3d tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Calling method '.version_select at 0x7f02705fc048>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:15.781806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-8cc07575-3796-4183-8a22-dbc29bdf9c3d tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] HTTP exception thrown: Volume 8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 could not be found. Dec 02 15:58:15.783177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8cc07575-3796-4183-8a22-dbc29bdf9c3d tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] Returning 404 to user: Volume 8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:15.784190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8cc07575-3796-4183-8a22-dbc29bdf9c3d tempest-VolumesGetTestJSON-118754526 tempest-VolumesGetTestJSON-118754526] 10.222.0.101 "GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0" status: 404 len: 109 microversion: 2.1 time: 0.090608 Dec 02 15:58:15.785024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 583/1104] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:58:15 2020] GET /compute/v2.1/os-volumes/8b21d96b-c127-4bec-a2b2-6f6d0b7f32d0 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:58:16.609750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:16.610412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:16.619188 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:16.620034 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:16.621148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:16.621823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:16.781650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:16.791663 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3a406679-efbb-4686-9a22-fda0eeccbe26 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1138 microversion: 2.1 time: 0.191701 Dec 02 15:58:16.791922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 522/1105] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:16 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1138 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:17.818836 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:17.819582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:17.852100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:17.852537 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:17.853505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:17.853998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:18.052303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:18.064142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f2ec6849-c295-473f-8a6f-3848d65f046a tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1212 microversion: 2.1 time: 0.257161 Dec 02 15:58:18.064741 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 584/1106] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:17 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1212 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:18.624679 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8135f091-9754-488f-aa36-288353f32ab1 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Action: 'create', calling method: .version_select at 0x7f0271942ae8>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2099492948", "metadata": {"Type": "work"}}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:18.626250 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8135f091-9754-488f-aa36-288353f32ab1 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:18.627129 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8135f091-9754-488f-aa36-288353f32ab1 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.171568 Dec 02 15:58:18.627760 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 523/1107] 10.222.0.101 () {60 vars in 1151 bytes} [Wed Dec 2 15:58:18 2020] POST /compute/v2.1/os-volumes => generated 127 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 02 15:58:18.644071 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b2331d2c-f1c5-4685-bdec-2e478ebb675f tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Action: 'create', calling method: .version_select at 0x7f027072dc80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1643497779", "metadata": {"Type": "work"}}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:18.645864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b2331d2c-f1c5-4685-bdec-2e478ebb675f tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:18.646778 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b2331d2c-f1c5-4685-bdec-2e478ebb675f tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012526 Dec 02 15:58:18.647388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 585/1108] 10.222.0.101 () {60 vars in 1151 bytes} [Wed Dec 2 15:58:18 2020] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 02 15:58:18.663102 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d4da5e30-bf16-4aba-82cd-452e5614f4a1 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Action: 'create', calling method: .version_select at 0x7f0263c44268>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1139029044", "metadata": {"Type": "work"}}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:18.665151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d4da5e30-bf16-4aba-82cd-452e5614f4a1 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:18.666021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d4da5e30-bf16-4aba-82cd-452e5614f4a1 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012873 Dec 02 15:58:18.666780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 524/1109] 10.222.0.101 () {60 vars in 1151 bytes} [Wed Dec 2 15:58:18 2020] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 02 15:58:18.682190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-47da6124-6fbb-429c-96d0-b094d885f34a tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Calling method '.version_select at 0x7f02707c7a60>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:18.754913 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-47da6124-6fbb-429c-96d0-b094d885f34a tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] HTTP exception thrown: Volume tempest-invalid-1136535286 could not be found. Dec 02 15:58:18.755613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-47da6124-6fbb-429c-96d0-b094d885f34a tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Returning 404 to user: Volume tempest-invalid-1136535286 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:18.756548 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-47da6124-6fbb-429c-96d0-b094d885f34a tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1136535286" status: 404 len: 99 microversion: 2.1 time: 0.083590 Dec 02 15:58:18.757172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 586/1110] 10.222.0.101 () {58 vars in 1213 bytes} [Wed Dec 2 15:58:18 2020] DELETE /compute/v2.1/os-volumes/tempest-invalid-1136535286 => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 02 15:58:18.772494 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-27a41fbe-56eb-41e7-b706-1592974a135c tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009411 Dec 02 15:58:18.773081 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 525/1111] 10.222.0.101 () {58 vars in 1135 bytes} [Wed Dec 2 15:58:18 2020] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 02 15:58:18.789307 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-482451d2-4c70-47b4-8bc4-222a428bdedf tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009324 Dec 02 15:58:18.790155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 587/1112] 10.222.0.101 () {58 vars in 1132 bytes} [Wed Dec 2 15:58:18 2020] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 02 15:58:18.806060 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-517eeef0-578f-43c6-8cf9-0897b9c58428 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Calling method '.version_select at 0x7f0271942ae8>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:18.885851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-517eeef0-578f-43c6-8cf9-0897b9c58428 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] HTTP exception thrown: Volume 1eb06d65-b1b7-491a-ac24-349ec6d8d23d could not be found. Dec 02 15:58:18.887076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-517eeef0-578f-43c6-8cf9-0897b9c58428 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Returning 404 to user: Volume 1eb06d65-b1b7-491a-ac24-349ec6d8d23d could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:18.888552 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-517eeef0-578f-43c6-8cf9-0897b9c58428 tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "DELETE /compute/v2.1/os-volumes/1eb06d65-b1b7-491a-ac24-349ec6d8d23d" status: 404 len: 109 microversion: 2.1 time: 0.091932 Dec 02 15:58:18.889331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 526/1113] 10.222.0.101 () {58 vars in 1243 bytes} [Wed Dec 2 15:58:18 2020] DELETE /compute/v2.1/os-volumes/1eb06d65-b1b7-491a-ac24-349ec6d8d23d => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:58:18.905618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dba0b5bb-5357-488f-b0bc-f7d16a58ba2d tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Calling method '.version_select at 0x7f027072de18>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:18.978339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-dba0b5bb-5357-488f-b0bc-f7d16a58ba2d tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] HTTP exception thrown: Volume e1d09836-27b4-40b6-ba58-d8cc2deb78f5 could not be found. Dec 02 15:58:18.979005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-dba0b5bb-5357-488f-b0bc-f7d16a58ba2d tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] Returning 404 to user: Volume e1d09836-27b4-40b6-ba58-d8cc2deb78f5 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 15:58:18.979908 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-dba0b5bb-5357-488f-b0bc-f7d16a58ba2d tempest-VolumesNegativeTest-1150606899 tempest-VolumesNegativeTest-1150606899] 10.222.0.101 "GET /compute/v2.1/os-volumes/e1d09836-27b4-40b6-ba58-d8cc2deb78f5" status: 404 len: 109 microversion: 2.1 time: 0.084593 Dec 02 15:58:18.980576 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 588/1114] 10.222.0.101 () {58 vars in 1240 bytes} [Wed Dec 2 15:58:18 2020] GET /compute/v2.1/os-volumes/e1d09836-27b4-40b6-ba58-d8cc2deb78f5 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 15:58:19.095759 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:19.096972 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:19.109362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:19.110261 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:19.112212 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:19.113255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:19.437206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:19.448886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-abf9b256-e71d-4835-85ef-76b47799f5f8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1287 microversion: 2.1 time: 0.368749 Dec 02 15:58:19.449750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 527/1115] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:19 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1287 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:20.484138 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:20.485451 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:20.498595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:20.499296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:20.500392 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:20.501125 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:20.908892 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-86f19a9d-5dab-4d99-bf9c-2eaae9dfa448 req-21d75ff9-f312-4a9f-99f4-f460f403fec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9efee87-4fd1-48c2-a550-4e5c53eaadea", "tag": "b880e84e-a589-470a-9389-3b8858f641bc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:20.920447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:58:20.920447 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:58:20.930641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-86f19a9d-5dab-4d99-bf9c-2eaae9dfa448 req-21d75ff9-f312-4a9f-99f4-f460f403fec2 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:20.931365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-86f19a9d-5dab-4d99-bf9c-2eaae9dfa448 req-21d75ff9-f312-4a9f-99f4-f460f403fec2 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:20.961023 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-86f19a9d-5dab-4d99-bf9c-2eaae9dfa448 req-21d75ff9-f312-4a9f-99f4-f460f403fec2 service nova] Creating event network-changed:b880e84e-a589-470a-9389-3b8858f641bc for instance a9efee87-4fd1-48c2-a550-4e5c53eaadea on hv-cinder-73761 Dec 02 15:58:20.970324 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-86f19a9d-5dab-4d99-bf9c-2eaae9dfa448 req-21d75ff9-f312-4a9f-99f4-f460f403fec2 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080348 Dec 02 15:58:20.972244 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 528/1116] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:58:20 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:58:21.110511 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:21.123821 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f0da5d45-df55-41b1-af92-42467fc6e205 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.659745 Dec 02 15:58:21.125116 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 589/1117] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:20 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:22.155276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:22.156342 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:22.164573 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:22.165094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:22.165959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:22.166470 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:22.432426 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:22.443943 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3886653d-721f-4839-bd1b-91cc91db97a9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.303280 Dec 02 15:58:22.444940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 529/1118] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:22 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:23.469027 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:23.469705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:23.478690 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:23.484805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:23.484805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:23.484805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:23.711313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:23.720948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-287ae8a8-ce6d-438e-8a2d-4e194e2c95fb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.261178 Dec 02 15:58:23.721559 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 590/1119] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:23 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:24.756593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:24.757259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:24.766026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:24.766531 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:24.767376 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:24.767864 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:25.009480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:25.019302 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5e06485b-eb72-4ea1-9a0d-17a4ca08adcb tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.272552 Dec 02 15:58:25.020154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 530/1120] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:24 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:26.045648 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:26.046326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:26.054463 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:26.054964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:26.055814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:26.056328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:26.287655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:26.297557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1467a34b-89ac-4172-9837-7302a048f49c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.262407 Dec 02 15:58:26.298180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 591/1121] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:26 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:27.322161 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:27.322838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:27.331143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:27.331646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:27.332523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:27.333018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:27.572014 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:27.581339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b605905a-3b28-4613-b5ea-18c9218707d4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.268469 Dec 02 15:58:27.581886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 531/1122] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:27 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:28.605704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:28.606868 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:28.614914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:28.615414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:28.616287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:28.616782 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:28.845890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:28.855011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4893f3d2-cafe-4d4f-a1da-d02a9b029042 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.258377 Dec 02 15:58:28.855624 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 592/1123] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:28 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:29.881429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:29.882486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:29.891731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:29.892294 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:29.893154 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:29.893670 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:30.146676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:30.165382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b52bad58-d054-4ab1-8aa6-acfabfc46cd4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.294531 Dec 02 15:58:30.166489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 532/1124] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:29 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:31.191205 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:31.191882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:31.199951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:31.200508 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:31.201354 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:31.201847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:31.436246 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:31.445543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3e2a24e1-9f53-4300-8f12-3bcfbc515b40 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.264345 Dec 02 15:58:31.446181 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 593/1125] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:31 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:32.470839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:32.471780 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:32.479829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:32.480362 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:32.481272 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:32.481775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:32.717420 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:32.726851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-93db1ec0-28c8-4a51-8059-e6b3bb98c4f9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.266172 Dec 02 15:58:32.727401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 533/1126] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:32 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:33.751157 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:33.751829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:33.759969 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:33.760513 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:33.761353 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:33.761833 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:34.011299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:34.021941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-af25037b-1bfd-4f99-86d6-fa8604fb7e10 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.280583 Dec 02 15:58:34.022636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 594/1127] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:33 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:34.696703 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-2d8ee112-1140-4297-b6e8-e4cec6524481 req-4464e3ba-b29a-4a49-ac3d-1ce4c6e3c4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9efee87-4fd1-48c2-a550-4e5c53eaadea", "name": "network-vif-plugged", "status": "completed", "tag": "b880e84e-a589-470a-9389-3b8858f641bc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:34.704374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:58:34.704374 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:58:34.713432 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-2d8ee112-1140-4297-b6e8-e4cec6524481 req-4464e3ba-b29a-4a49-ac3d-1ce4c6e3c4ff service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:34.713939 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-2d8ee112-1140-4297-b6e8-e4cec6524481 req-4464e3ba-b29a-4a49-ac3d-1ce4c6e3c4ff service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:34.739476 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-2d8ee112-1140-4297-b6e8-e4cec6524481 req-4464e3ba-b29a-4a49-ac3d-1ce4c6e3c4ff service nova] Creating event network-vif-plugged:b880e84e-a589-470a-9389-3b8858f641bc for instance a9efee87-4fd1-48c2-a550-4e5c53eaadea on hv-cinder-73761 Dec 02 15:58:34.745326 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-2d8ee112-1140-4297-b6e8-e4cec6524481 req-4464e3ba-b29a-4a49-ac3d-1ce4c6e3c4ff service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059435 Dec 02 15:58:34.745985 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 534/1128] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:58:34 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:58:35.051580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:35.052522 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:35.061852 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:35.062327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:35.063198 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:35.063698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:35.365901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:35.376329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8f10cf91-7ff2-484f-abdb-05786a97253f tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.339158 Dec 02 15:58:35.376947 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 595/1129] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:35 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:36.404401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:36.405190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:36.419022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:36.419533 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:36.420604 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:36.421178 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:36.737570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 15:58:36.737912 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 15:58:36 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea (ip 10.222.0.101) !!! Dec 02 15:58:36.849589 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:36.860215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b4d1e539-c166-488c-bae7-0ac9e3fc340d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1275 microversion: 2.1 time: 0.466938 Dec 02 15:58:36.861120 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 535/1130] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:36 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1275 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:37.896096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:37.897185 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:37.910851 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:37.911695 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:37.913193 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:37.914021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:38.183118 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:38.194069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-897f6026-59fa-4792-b2a5-21e42a5656e8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1463 microversion: 2.1 time: 0.318715 Dec 02 15:58:38.194707 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 596/1131] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:37 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1463 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:38.230975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:38.231469 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:38.240424 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:38.240861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:38.241730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:38.242222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:38.494866 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:38.504744 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-09f42cad-6dfa-48dc-b5ed-ffaca4518e43 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1463 microversion: 2.1 time: 0.283188 Dec 02 15:58:38.505378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 536/1132] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:38 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1463 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:38.529405 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c9a62970-b8db-4f6b-aef3-c1ee1a66d79c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'create', calling method: .version_select at 0x7f02705fcb70>, body: {"pool": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:41.513553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c9a62970-b8db-4f6b-aef3-c1ee1a66d79c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.993928 Dec 02 15:58:41.514262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 597/1133] 10.222.0.101 () {60 vars in 1165 bytes} [Wed Dec 2 15:58:38 2020] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:58:41.532167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.0.174"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:41.533479 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:41.541879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:41.542391 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:41.543787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:41.544344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:41.620961 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Acquired lock "refresh_cache-a9efee87-4fd1-48c2-a550-4e5c53eaadea" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 15:58:43.792395 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Building network info cache for instance {{(pid=94391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 15:58:43.816021 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-37301155-c529-4f1e-bc38-7ff6df30f46e req-84548590-a86f-495e-a956-ba1957a2162d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9efee87-4fd1-48c2-a550-4e5c53eaadea", "tag": "b880e84e-a589-470a-9389-3b8858f641bc"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:43.823295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:58:43.823295 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:58:43.834124 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-37301155-c529-4f1e-bc38-7ff6df30f46e req-84548590-a86f-495e-a956-ba1957a2162d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:43.835005 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-37301155-c529-4f1e-bc38-7ff6df30f46e req-84548590-a86f-495e-a956-ba1957a2162d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:43.855133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-37301155-c529-4f1e-bc38-7ff6df30f46e req-84548590-a86f-495e-a956-ba1957a2162d service nova] Creating event network-changed:b880e84e-a589-470a-9389-3b8858f641bc for instance a9efee87-4fd1-48c2-a550-4e5c53eaadea on hv-cinder-73761 Dec 02 15:58:43.862462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-37301155-c529-4f1e-bc38-7ff6df30f46e req-84548590-a86f-495e-a956-ba1957a2162d service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063761 Dec 02 15:58:43.863527 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 598/1134] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:58:43 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 15:58:44.718956 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Updating instance_info_cache with network_info: [{"id": "b880e84e-a589-470a-9389-3b8858f641bc", "address": "fa:16:3e:91:9e:17", "network": {"id": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1674399377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.0.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e84bacbd36bc4a75898431f75ffae141", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapb880e84e-a5", "ovs_interfaceid": "b880e84e-a589-470a-9389-3b8858f641bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 15:58:44.770765 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Releasing lock "refresh_cache-a9efee87-4fd1-48c2-a550-4e5c53eaadea" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 15:58:44.772806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3696146c-04f1-48a6-b527-f092eb7b3809 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "POST /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea/action" status: 202 len: 0 microversion: 2.1 time: 3.249853 Dec 02 15:58:44.774119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 537/1135] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:58:41 2020] POST /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea/action => generated 0 bytes in 3252 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 02 15:58:48.360752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:58:48.361442 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:48.369740 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:48.370219 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:48.371811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:48.372365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:48.439743 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lazy-loading 'flavor' on Instance uuid 88e84b35-1972-4148-a6f7-a4753c5c6f2d {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 15:58:48.674214 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2e4d1ab4-6b15-44b6-a7a3-d16d488b07bc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.323751 Dec 02 15:58:48.674887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 599/1136] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:58:48 2020] POST /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 15:58:48.689907 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:48.690504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:48.698653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:48.699378 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:48.700803 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:48.701299 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:48.935018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:48.944304 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-78560926-0800-45ad-a229-518e5eb1f794 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.264438 Dec 02 15:58:48.944847 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 538/1137] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:48 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:49.970203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:49.971139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:49.979452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:49.979945 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:49.981323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:49.981808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:50.213646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:50.223732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-238e6547-93f0-46e8-a1b0-c51c9f4e3e76 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.263718 Dec 02 15:58:50.224314 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 600/1138] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:49 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:51.250305 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:51.250975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:51.259143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:51.259655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:51.260517 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:51.261011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:51.490883 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:51.500644 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-7b10dd2e-7cf2-49fb-8d12-25b2aa17f9bf tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.261339 Dec 02 15:58:51.501243 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 539/1139] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:51 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:52.524580 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:52.525183 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:52.534024 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:52.534538 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:52.535388 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:52.535884 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:52.773390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:52.783840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-98d5cd2e-4300-4de5-b368-eba5735c3b3d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.268714 Dec 02 15:58:52.784481 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 601/1140] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:52 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:53.808329 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:53.809372 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:53.818142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:53.818427 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:53.819296 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:53.819753 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:54.085906 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:54.098669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-53496e2f-1b45-4944-b921-1bdcbf905ce1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.299953 Dec 02 15:58:54.099421 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 540/1141] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:53 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:55.125092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:55.125844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:55.134344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:55.134849 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:55.135704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:55.136303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:55.380437 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:55.390287 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5d23b665-14ed-4a8f-ac49-89a96f9f462f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.275722 Dec 02 15:58:55.390914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 602/1142] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:55 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:56.415471 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:56.416139 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:56.425009 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:56.425532 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:56.426387 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:56.426886 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:56.670808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:56.681163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f2e0a40b-647b-4334-a627-19f96105fb6d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.275482 Dec 02 15:58:56.681774 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 541/1143] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:56 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:57.707717 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:57.711683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:57.717128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:57.717637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:57.718483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:57.718974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:58.028940 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:58.042046 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b72a69b5-ba61-4dc3-b000-e16c34dcbee0 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.344766 Dec 02 15:58:58.043950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 603/1144] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:57 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:58:59.078054 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:58:59.078658 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:58:59.087268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:59.087814 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:59.088897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:58:59.089810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:58:59.348711 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:58:59.358967 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f43dc157-407d-4822-a630-11c86ed1dd57 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.292687 Dec 02 15:58:59.359676 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 542/1145] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:58:59 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:00.384930 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:00.385742 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:00.395283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:00.395727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:00.396600 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:00.397095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:00.702358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:00.712954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5b553e1b-7c73-4eab-abc5-d906d78589aa tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.338657 Dec 02 15:59:00.713683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 604/1146] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:00 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:01.744303 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:01.746170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:01.756401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:01.756401 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:01.757056 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:01.757632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:02.050452 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:02.062936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-00045942-76c4-4114-b779-3e74e0306c2e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.328429 Dec 02 15:59:02.063787 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 543/1147] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:01 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:03.103186 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:03.104240 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:03.113328 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:03.113588 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:03.114417 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:03.115097 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:03.349593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:03.365022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3b5b9399-699b-4a6e-a23a-fa228d0f112e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.278659 Dec 02 15:59:03.366076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 605/1148] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:03 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:04.398952 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:04.399632 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:04.408171 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:04.408683 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:04.409547 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:04.410040 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:04.648119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:04.657954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e598ba47-fc68-43f1-8c43-a66c67e850c3 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1574 microversion: 2.1 time: 0.268394 Dec 02 15:59:04.658554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 544/1149] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:04 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1574 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:05.682170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:05.683408 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:05.691716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:05.692283 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:05.693946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:05.693946 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:05.934879 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:05.943948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-96c11113-1cc7-43ee-854e-d6ba69842840 req-8b84eb26-1128-4ff6-bd7a-571c89e3aef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:59:05.944327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-37966436-db4a-4d15-8756-809351f0b585 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1575 microversion: 2.1 time: 0.271763 Dec 02 15:59:05.945020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 606/1150] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:05 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:05.951767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:59:05.951767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:59:05.961613 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-96c11113-1cc7-43ee-854e-d6ba69842840 req-8b84eb26-1128-4ff6-bd7a-571c89e3aef8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:05.962172 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-96c11113-1cc7-43ee-854e-d6ba69842840 req-8b84eb26-1128-4ff6-bd7a-571c89e3aef8 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:05.968262 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:59:05.968890 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:05.983215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:05.983697 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-96c11113-1cc7-43ee-854e-d6ba69842840 req-8b84eb26-1128-4ff6-bd7a-571c89e3aef8 service nova] Creating event network-vif-unplugged:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 15:59:05.984096 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:05.985628 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:05.986490 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:05.989655 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-96c11113-1cc7-43ee-854e-d6ba69842840 req-8b84eb26-1128-4ff6-bd7a-571c89e3aef8 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055149 Dec 02 15:59:05.990334 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 545/1151] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:59:05 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:59:06.265731 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e9f1e74c-dc21-4a83-816c-c3ad38b0e5a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "POST /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.306882 Dec 02 15:59:06.266885 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 607/1152] 10.222.0.101 () {60 vars in 1273 bytes} [Wed Dec 2 15:59:05 2020] POST /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 02 15:59:06.282661 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:06.283646 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:06.294484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:06.294975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:06.296878 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:06.297727 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:06.575837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:06.585297 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-491cd3a5-76c4-4fdf-a877-c872b4fe8a65 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1523 microversion: 2.1 time: 0.314024 Dec 02 15:59:06.585921 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 546/1153] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:06 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:07.612691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:07.613691 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:07.623914 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:07.624337 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:07.625201 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:07.625781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:07.864763 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:07.875610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1fc374fa-65ee-440f-9e11-5de69cc26e8e tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1525 microversion: 2.1 time: 0.274301 Dec 02 15:59:07.876255 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 608/1154] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:07 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1525 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:08.902650 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:08.903200 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:08.911998 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:08.912526 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:08.913406 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:08.913916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:09.163553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:09.173671 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-693fc45e-afb4-4818-8160-82c936cb0fc5 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1525 microversion: 2.1 time: 0.281576 Dec 02 15:59:09.174373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 547/1155] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:08 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1525 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:10.199553 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:10.201215 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:10.210465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:10.211010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:10.211869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:10.212381 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:10.530317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:10.539554 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-60d113b4-6f23-4aa5-b7ab-10a99f48f7ae tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.350227 Dec 02 15:59:10.540199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 609/1156] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:10 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:11.566987 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:11.567656 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:11.576127 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:11.576641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:11.577488 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:11.577970 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:11.809698 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:11.820642 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-4129974c-ef1d-465b-9b52-6fc0c91c4e6f tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.265765 Dec 02 15:59:11.821268 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 548/1157] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:11 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:12.847026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:12.847705 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:12.856584 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:12.856971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:12.857855 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:12.858489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:13.100148 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:13.111318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d61eab1a-8904-44c8-b932-5bef2b2698b9 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.273385 Dec 02 15:59:13.111318 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 610/1158] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:12 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:14.136789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:14.136789 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:14.145147 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:14.145667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:14.146535 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:14.147029 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:14.473278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:14.483856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b6cafb83-b110-4baa-884a-4bb061b78c55 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.357806 Dec 02 15:59:14.484504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 549/1159] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:14 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:15.524922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:15.525598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:15.534899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:15.535700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:15.536581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:15.537077 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:15.956935 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:15.976747 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1e2b2f1d-ac3f-4f3d-abcb-e27ada8a859a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.477682 Dec 02 15:59:15.978137 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 611/1160] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:15 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:17.005899 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:17.007167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:17.021092 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:17.022286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:17.024020 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:17.024808 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:17.283331 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:17.293003 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-c9fd67c3-6734-416c-bed5-21093fc06d34 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.296354 Dec 02 15:59:17.293630 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 550/1161] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:16 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:18.318598 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:18.319557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:18.328475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:18.328979 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:18.329831 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:18.332735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:18.575950 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:18.585901 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-eb80163d-40bd-4fca-a699-b8e3b7f1b13c tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.277060 Dec 02 15:59:18.586838 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 612/1162] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:18 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:18.925844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-4bb695c0-9e9f-4fab-ae86-e4f1331fb920 req-672cd1c0-4f1b-4e61-8911-b69da3121dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "name": "network-vif-plugged", "status": "completed", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 15:59:18.931641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 15:59:18.931641 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 15:59:18.941818 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-4bb695c0-9e9f-4fab-ae86-e4f1331fb920 req-672cd1c0-4f1b-4e61-8911-b69da3121dc3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:18.942320 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-4bb695c0-9e9f-4fab-ae86-e4f1331fb920 req-672cd1c0-4f1b-4e61-8911-b69da3121dc3 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:18.963143 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-4bb695c0-9e9f-4fab-ae86-e4f1331fb920 req-672cd1c0-4f1b-4e61-8911-b69da3121dc3 service nova] Creating event network-vif-plugged:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 15:59:18.968786 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-4bb695c0-9e9f-4fab-ae86-e4f1331fb920 req-672cd1c0-4f1b-4e61-8911-b69da3121dc3 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.240257 Dec 02 15:59:18.969509 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 551/1163] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 15:59:18 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 15:59:19.623030 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:19.624371 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:19.642674 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:19.643581 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:19.645053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:19.645579 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:20.032313 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:20.043365 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d9c319a9-4a93-407d-923a-adcca5a4512a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1581 microversion: 2.1 time: 0.440970 Dec 02 15:59:20.044231 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 613/1164] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:19 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1581 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 15:59:21.091267 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 15:59:21.104310 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 15:59:21.116614 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:21.120199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:21.120199 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 15:59:21.120423 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 15:59:21.377078 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 15:59:21.387133 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-95c039f4-d2ae-43df-a87d-f586d4abb460 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1568 microversion: 2.1 time: 0.317745 Dec 02 15:59:21.387768 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 552/1165] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 15:59:21 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 16:00:12.017519 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: ERROR oslo.messaging._drivers.impl_rabbit [-] [07aa14a9-9e13-4c27-a494-8bf09fb36391] AMQP server on 10.222.0.101:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 02 16:00:12.027018 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '.version_select at 0x7f02707c7400>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:12.557348 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:12.573662 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:12.574652 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:12.576101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:12.576994 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:12.658618 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Acquired lock "refresh_cache-a9efee87-4fd1-48c2-a550-4e5c53eaadea" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 16:00:13.035357 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] [07aa14a9-9e13-4c27-a494-8bf09fb36391] Reconnected to AMQP server on 10.222.0.101:5672 via [amqp] client with port 47050. Dec 02 16:00:14.903206 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Building network info cache for instance {{(pid=94390) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 16:00:15.179317 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-59709b89-b028-4645-94a0-7256e30f361d req-ee033026-0415-4490-980a-4eabd512adc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9efee87-4fd1-48c2-a550-4e5c53eaadea", "tag": "b880e84e-a589-470a-9389-3b8858f641bc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:15.195413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:15.195413 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:15.207570 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-59709b89-b028-4645-94a0-7256e30f361d req-ee033026-0415-4490-980a-4eabd512adc7 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:15.208397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-59709b89-b028-4645-94a0-7256e30f361d req-ee033026-0415-4490-980a-4eabd512adc7 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:15.233673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-59709b89-b028-4645-94a0-7256e30f361d req-ee033026-0415-4490-980a-4eabd512adc7 service nova] Creating event network-changed:b880e84e-a589-470a-9389-3b8858f641bc for instance a9efee87-4fd1-48c2-a550-4e5c53eaadea on hv-cinder-73761 Dec 02 16:00:15.243119 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-59709b89-b028-4645-94a0-7256e30f361d req-ee033026-0415-4490-980a-4eabd512adc7 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.333593 Dec 02 16:00:15.244611 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 553/1166] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:14 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 16:00:17.042716 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Updating instance_info_cache with network_info: [{"id": "b880e84e-a589-470a-9389-3b8858f641bc", "address": "fa:16:3e:91:9e:17", "network": {"id": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1674399377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e84bacbd36bc4a75898431f75ffae141", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapb880e84e-a5", "ovs_interfaceid": "b880e84e-a589-470a-9389-3b8858f641bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94390) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 16:00:17.127829 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Releasing lock "refresh_cache-a9efee87-4fd1-48c2-a550-4e5c53eaadea" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 16:00:17.129011 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-492d38aa-ea5e-4df2-a750-a6a693b46612 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/os-floating-ips/3af24b65-169a-40df-a31d-3cebb3040c9f" status: 202 len: 0 microversion: 2.1 time: 5.113137 Dec 02 16:00:17.130117 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 614/1167] 10.222.0.101 () {58 vars in 1258 bytes} [Wed Dec 2 16:00:12 2020] DELETE /compute/v2.1/os-floating-ips/3af24b65-169a-40df-a31d-3cebb3040c9f => generated 0 bytes in 5115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:17.145704 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:17.146293 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:17.155397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:17.155916 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:17.156810 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:17.157309 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:17.235902 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 16:00:17.492974 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-75337968-d7ce-4661-8d72-f043a23eaaf6 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 204 len: 0 microversion: 2.1 time: 0.357888 Dec 02 16:00:17.493608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 554/1168] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 16:00:17 2020] DELETE /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 16:00:17.514572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:17.516226 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:17.524224 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:17.524735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:17.526197 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:17.526752 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:17.929958 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:17.939222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-14d0cb04-05b8-4d07-8425-66599e3745b9 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1469 microversion: 2.1 time: 0.435812 Dec 02 16:00:17.940151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 615/1169] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:17 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1469 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:18.981093 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:18.981882 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:18.991155 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:18.991673 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:18.993264 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:18.993775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:19.234203 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:19.243543 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-78081798-535f-4f41-b3bd-18bb5d3da7ca tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1469 microversion: 2.1 time: 0.273940 Dec 02 16:00:19.244823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 555/1170] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:18 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1469 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:20.274924 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:20.276953 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:20.287049 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:20.287556 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:20.288448 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:20.288936 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:20.657767 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:20.667520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-de3fc471-0371-40e1-9a49-17b95e06fcf8 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1469 microversion: 2.1 time: 0.402337 Dec 02 16:00:20.668167 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 616/1171] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:20 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1469 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:20.872551 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-2aeb647c-ecd9-4a48-a48d-b3eda9494351 req-a135079d-910e-451f-90ef-59d6437e7150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9efee87-4fd1-48c2-a550-4e5c53eaadea", "name": "network-vif-deleted", "tag": "b880e84e-a589-470a-9389-3b8858f641bc"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:20.880805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:20.880805 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:20.890636 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-2aeb647c-ecd9-4a48-a48d-b3eda9494351 req-a135079d-910e-451f-90ef-59d6437e7150 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:20.891237 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-2aeb647c-ecd9-4a48-a48d-b3eda9494351 req-a135079d-910e-451f-90ef-59d6437e7150 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:20.911100 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-2aeb647c-ecd9-4a48-a48d-b3eda9494351 req-a135079d-910e-451f-90ef-59d6437e7150 service nova] Creating event network-vif-deleted:b880e84e-a589-470a-9389-3b8858f641bc for instance a9efee87-4fd1-48c2-a550-4e5c53eaadea on hv-cinder-73761 Dec 02 16:00:20.917560 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-2aeb647c-ecd9-4a48-a48d-b3eda9494351 req-a135079d-910e-451f-90ef-59d6437e7150 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055356 Dec 02 16:00:20.919497 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 556/1172] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:20 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 16:00:21.703211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:21.704500 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:21.717281 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:21.717999 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:21.718801 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:21.719300 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:21.802762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:21.803266 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:21.803775 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lazy-loading 'fault' on Instance uuid a9efee87-4fd1-48c2-a550-4e5c53eaadea {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 16:00:21.925823 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:21.935462 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-a624d8d9-d185-4d1e-a9a5-28973547fb07 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 200 len: 1232 microversion: 2.1 time: 0.252380 Dec 02 16:00:21.936123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 617/1173] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:21 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 1232 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:22.593506 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:00:22.593781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:00:22 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:00:22.960327 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:22.961104 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: a9efee87-4fd1-48c2-a550-4e5c53eaadea] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:22.970067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:22.970582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:22.971444 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:22.972233 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:23.029959 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] HTTP exception thrown: Instance a9efee87-4fd1-48c2-a550-4e5c53eaadea could not be found. Dec 02 16:00:23.030549 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Returning 404 to user: Instance a9efee87-4fd1-48c2-a550-4e5c53eaadea could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 16:00:23.031464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-348973c1-1aae-44bd-a293-1c9546e1fce2 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea" status: 404 len: 111 microversion: 2.1 time: 0.081235 Dec 02 16:00:23.032098 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 557/1174] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:22 2020] GET /compute/v2.1/servers/a9efee87-4fd1-48c2-a550-4e5c53eaadea => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 16:00:25.574954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '.version_select at 0x7f02707c7488>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:26.133439 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:26.143067 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:26.143489 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:26.144383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:26.144881 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:26.210170 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Acquired lock "refresh_cache-78341935-3dc2-452e-a748-a46473230141" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 16:00:28.302608 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Building network info cache for instance {{(pid=94390) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 16:00:28.319483 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-d6290d84-55bd-4d74-abc5-c7cde0280787 req-98d0942e-a37b-45ab-9e24-51269275b07e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78341935-3dc2-452e-a748-a46473230141", "tag": "a1b80e49-be90-44c1-870d-de3cc7b6ba08"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:28.326404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:28.326404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:28.335964 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-d6290d84-55bd-4d74-abc5-c7cde0280787 req-98d0942e-a37b-45ab-9e24-51269275b07e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:28.336486 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-d6290d84-55bd-4d74-abc5-c7cde0280787 req-98d0942e-a37b-45ab-9e24-51269275b07e service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:28.357472 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-d6290d84-55bd-4d74-abc5-c7cde0280787 req-98d0942e-a37b-45ab-9e24-51269275b07e service nova] Creating event network-changed:a1b80e49-be90-44c1-870d-de3cc7b6ba08 for instance 78341935-3dc2-452e-a748-a46473230141 on hv-cinder-73761 Dec 02 16:00:28.363043 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-d6290d84-55bd-4d74-abc5-c7cde0280787 req-98d0942e-a37b-45ab-9e24-51269275b07e service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053768 Dec 02 16:00:28.364032 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 558/1175] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:28 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 02 16:00:29.859446 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Updating instance_info_cache with network_info: [{"id": "a1b80e49-be90-44c1-870d-de3cc7b6ba08", "address": "fa:16:3e:b5:b4:07", "network": {"id": "fb4a3f3f-f009-42fb-af5a-e60d7446ffbb", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1674399377-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e84bacbd36bc4a75898431f75ffae141", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapa1b80e49-be", "ovs_interfaceid": "a1b80e49-be90-44c1-870d-de3cc7b6ba08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94390) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 16:00:29.899254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Releasing lock "refresh_cache-78341935-3dc2-452e-a748-a46473230141" {{(pid=94390) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 16:00:29.900274 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ba74fc26-ade2-4481-9f77-cb96e93ffc77 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/os-floating-ips/59b88589-1f49-4141-8a84-359beb503bff" status: 202 len: 0 microversion: 2.1 time: 4.335183 Dec 02 16:00:29.901131 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 618/1176] 10.222.0.101 () {58 vars in 1258 bytes} [Wed Dec 2 16:00:25 2020] DELETE /compute/v2.1/os-floating-ips/59b88589-1f49-4141-8a84-359beb503bff => generated 0 bytes in 4337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:29.916491 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:29.917194 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:29.925989 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:29.926510 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:29.927383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:29.927888 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:30.007101 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Going to try to terminate instance {{(pid=94391) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 16:00:30.249275 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e66c2184-2eb6-413b-95fa-d08bc0b2a858 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 204 len: 0 microversion: 2.1 time: 0.342712 Dec 02 16:00:30.251339 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 559/1177] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 16:00:29 2020] DELETE /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 16:00:30.265672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:30.266356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:30.276242 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:30.276796 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:30.277682 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:30.278177 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:30.565702 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:30.575748 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-b19133a6-eabb-4bf1-8e7c-09f1eaeba491 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1469 microversion: 2.1 time: 0.320697 Dec 02 16:00:30.576383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 619/1178] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:30 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:31.592672 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb61c3ef-4930-4aa7-9539-267f6e29d75f] AMQP server on 10.222.0.101:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 02 16:00:31.602285 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:31.603771 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:31.611904 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:31.612438 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:31.613276 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:31.613764 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:31.841385 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:31.850863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-ff638ad6-ef37-47e1-9daa-6bf39c1166b5 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1469 microversion: 2.1 time: 0.259732 Dec 02 16:00:31.851373 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 560/1179] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:31 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:32.875839 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:32.876605 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:32.886330 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:32.886844 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:32.887653 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:32.888396 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:33.081736 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:33.104222 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-d0eea81d-1c13-4972-9a09-35e89dce845c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1394 microversion: 2.1 time: 0.237108 Dec 02 16:00:33.106323 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 620/1180] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:32 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1394 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:33.217069 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-09625f0a-66ee-41a6-9dbb-7bf594875cc7 req-e78e58ad-454d-4340-a734-ca56c976d716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78341935-3dc2-452e-a748-a46473230141", "name": "network-vif-deleted", "tag": "a1b80e49-be90-44c1-870d-de3cc7b6ba08"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:33.224288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:33.224288 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:33.247076 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-09625f0a-66ee-41a6-9dbb-7bf594875cc7 req-e78e58ad-454d-4340-a734-ca56c976d716 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:33.247587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-09625f0a-66ee-41a6-9dbb-7bf594875cc7 req-e78e58ad-454d-4340-a734-ca56c976d716 service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:33.269123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb61c3ef-4930-4aa7-9539-267f6e29d75f] Reconnected to AMQP server on 10.222.0.101:5672 via [amqp] client with port 47234. Dec 02 16:00:33.271338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-09625f0a-66ee-41a6-9dbb-7bf594875cc7 req-e78e58ad-454d-4340-a734-ca56c976d716 service nova] Creating event network-vif-deleted:a1b80e49-be90-44c1-870d-de3cc7b6ba08 for instance 78341935-3dc2-452e-a748-a46473230141 on hv-cinder-73761 Dec 02 16:00:33.276856 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-09625f0a-66ee-41a6-9dbb-7bf594875cc7 req-e78e58ad-454d-4340-a734-ca56c976d716 service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069285 Dec 02 16:00:33.277523 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 561/1181] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:33 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 16:00:34.139869 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:34.140601 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:34.148937 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:34.149516 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:34.150383 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:34.150880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:34.240587 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:34.241507 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:34.242414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lazy-loading 'fault' on Instance uuid 78341935-3dc2-452e-a748-a46473230141 {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 16:00:34.370487 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd269a2a6f71e40538a8b7b7a199ec693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e84bacbd36bc4a75898431f75ffae141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:34.380668 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f36dc6ed-8528-422e-b6c7-0c07dd47dfaf tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 200 len: 1233 microversion: 2.1 time: 0.249961 Dec 02 16:00:34.381180 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 621/1182] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:34 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 1233 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:35.416386 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:35.417123 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 78341935-3dc2-452e-a748-a46473230141] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:35.425572 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:35.426063 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:35.426922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:35.427414 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:35.484278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] HTTP exception thrown: Instance 78341935-3dc2-452e-a748-a46473230141 could not be found. Dec 02 16:00:35.484975 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Returning 404 to user: Instance 78341935-3dc2-452e-a748-a46473230141 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 16:00:35.485889 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-3f0715e1-d3c7-41cc-8fb3-c1f3ca65e92c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141" status: 404 len: 111 microversion: 2.1 time: 0.080655 Dec 02 16:00:35.486505 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 562/1183] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:35 2020] GET /compute/v2.1/servers/78341935-3dc2-452e-a748-a46473230141 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 16:00:35.501577 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-2b0e123a-1b93-4a98-85d7-6d89b7c1d9e4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '.version_select at 0x7f02707c72f0>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:37.101700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-2b0e123a-1b93-4a98-85d7-6d89b7c1d9e4 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/os-floating-ips/0a26395d-7f3f-4e94-8339-cc2f2be71013" status: 202 len: 0 microversion: 2.1 time: 1.610291 Dec 02 16:00:37.103211 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 622/1184] 10.222.0.101 () {58 vars in 1258 bytes} [Wed Dec 2 16:00:35 2020] DELETE /compute/v2.1/os-floating-ips/0a26395d-7f3f-4e94-8339-cc2f2be71013 => generated 0 bytes in 1612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:37.123010 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:37.123732 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:37.134667 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:37.135174 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:37.136061 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:37.136557 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:37.216773 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] HTTP exception thrown: Instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 could not be found. Dec 02 16:00:37.217460 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Returning 404 to user: Instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 16:00:37.218394 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-1c72c674-b81d-4fc1-b3dc-157f0d5a0999 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 404 len: 111 microversion: 2.1 time: 0.107420 Dec 02 16:00:37.219022 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 563/1185] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 16:00:37 2020] DELETE /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 16:00:37.236398 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:37.237079 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] [instance: 7c6186d2-2516-45ad-b5a8-659eda7064a7] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:37.248292 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:37.248799 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:37.249699 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:37.250191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:37.313616 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] HTTP exception thrown: Instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 could not be found. Dec 02 16:00:37.314184 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Returning 404 to user: Instance 7c6186d2-2516-45ad-b5a8-659eda7064a7 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 16:00:37.315113 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-e7b3950e-dc95-4ee2-a46b-4090afe1641d tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7" status: 404 len: 111 microversion: 2.1 time: 0.090858 Dec 02 16:00:37.315735 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 623/1186] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:37 2020] GET /compute/v2.1/servers/7c6186d2-2516-45ad-b5a8-659eda7064a7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 16:00:38.690837 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-87f9b040-eb4e-4a21-b54f-9d82a7051fa1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '.version_select at 0x7f0263fedb70>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:39.042108 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-87f9b040-eb4e-4a21-b54f-9d82a7051fa1 tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/os-security-groups/84b94ee0-92cf-4dbe-8dc6-c45763dad97a" status: 202 len: 0 microversion: 2.1 time: 0.360699 Dec 02 16:00:39.042941 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 564/1187] 10.222.0.101 () {58 vars in 1267 bytes} [Wed Dec 2 16:00:38 2020] DELETE /compute/v2.1/os-security-groups/84b94ee0-92cf-4dbe-8dc6-c45763dad97a => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:39.057770 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-8986ddb0-6a9b-40f6-b1cb-3d25e347265c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] Calling method '.version_select at 0x7f0271a66d90>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:39.112520 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-8986ddb0-6a9b-40f6-b1cb-3d25e347265c tempest-TestVolumeBootPattern-1300456099 tempest-TestVolumeBootPattern-1300456099] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-274750580" status: 202 len: 0 microversion: 2.1 time: 0.064723 Dec 02 16:00:39.113654 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 624/1188] 10.222.0.101 () {58 vars in 1255 bytes} [Wed Dec 2 16:00:39 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-274750580 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:40.409922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '.version_select at 0x7f02710a20d0>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:41.131954 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:41.140983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:41.141496 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:41.142356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:41.142848 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:41.207358 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Acquired lock "refresh_cache-88e84b35-1972-4148-a6f7-a4753c5c6f2d" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 02 16:00:44.867286 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Building network info cache for instance {{(pid=94391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1832}} Dec 02 16:00:45.225136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-de87ec5c-46ca-42ae-b92b-f8f89831f515 req-b90bfe9b-2abb-4426-9e72-8a47a0f1882a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:45.234359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:45.234359 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:45.246666 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-de87ec5c-46ca-42ae-b92b-f8f89831f515 req-b90bfe9b-2abb-4426-9e72-8a47a0f1882a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:45.246897 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-de87ec5c-46ca-42ae-b92b-f8f89831f515 req-b90bfe9b-2abb-4426-9e72-8a47a0f1882a service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:45.268459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-de87ec5c-46ca-42ae-b92b-f8f89831f515 req-b90bfe9b-2abb-4426-9e72-8a47a0f1882a service nova] Creating event network-changed:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 16:00:45.275412 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-de87ec5c-46ca-42ae-b92b-f8f89831f515 req-b90bfe9b-2abb-4426-9e72-8a47a0f1882a service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401697 Dec 02 16:00:45.277033 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 625/1189] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:44 2020] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 16:00:46.332762 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.network.neutron [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Updating instance_info_cache with network_info: [{"id": "4e88c508-63bd-4782-ab84-478ed9ae3bb4", "address": "fa:16:3e:f8:2d:77", "network": {"id": "b49751da-eb0e-4ecb-880c-88dd1ff589c9", "bridge": "br-int", "label": "tempest-TestShelveInstance-1860306437-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "92c709d41db94ec88054f3a048762c37", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap4e88c508-63", "ovs_interfaceid": "4e88c508-63bd-4782-ab84-478ed9ae3bb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=94391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 02 16:00:46.385202 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Releasing lock "refresh_cache-88e84b35-1972-4148-a6f7-a4753c5c6f2d" {{(pid=94391) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 02 16:00:46.386140 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-50ff2d21-20b1-429e-a5d2-14679ce05841 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "DELETE /compute/v2.1/os-floating-ips/ee1a5794-abca-42da-958d-26f64e29fdc3" status: 202 len: 0 microversion: 2.1 time: 5.986884 Dec 02 16:00:46.388031 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 565/1190] 10.222.0.101 () {58 vars in 1258 bytes} [Wed Dec 2 16:00:40 2020] DELETE /compute/v2.1/os-floating-ips/ee1a5794-abca-42da-958d-26f64e29fdc3 => generated 0 bytes in 5989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:46.402813 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:46.404382 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:46.418591 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:46.419478 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:46.420482 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:46.421105 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:46.578338 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Going to try to terminate instance {{(pid=94390) delete /opt/stack/nova/nova/compute/api.py:2536}} Dec 02 16:00:46.830710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-995a191b-a24f-4909-8033-81f22253506a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "DELETE /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 204 len: 0 microversion: 2.1 time: 0.437311 Dec 02 16:00:46.831504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 626/1191] 10.222.0.101 () {58 vars in 1234 bytes} [Wed Dec 2 16:00:46 2020] DELETE /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 02 16:00:46.846290 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:46.847521 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:46.857026 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:46.857546 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:46.858409 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:46.858909 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:47.197532 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:47.208191 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-f16fe1eb-7bfd-4c79-8f84-7620f8687b8d tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1457 microversion: 2.1 time: 0.371708 Dec 02 16:00:47.208934 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 566/1192] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:46 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1457 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:48.411397 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:48.412208 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:48.420781 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:48.421720 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:48.422637 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:48.423344 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:49.074259 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:49.085465 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fac6310c-94ac-4d30-ad9f-0bcf7ea93bc1 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1457 microversion: 2.1 time: 0.861801 Dec 02 16:00:49.094142 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 627/1193] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:48 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1457 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:49.385083 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-453ca9a8-7bcf-4c73-96f0-25665e455ef4 req-2ee85b89-3d4d-49db-9060-d0aa6f1bd6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:49.392435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:49.392435 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:49.402356 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-453ca9a8-7bcf-4c73-96f0-25665e455ef4 req-2ee85b89-3d4d-49db-9060-d0aa6f1bd6ea service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:49.402863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-453ca9a8-7bcf-4c73-96f0-25665e455ef4 req-2ee85b89-3d4d-49db-9060-d0aa6f1bd6ea service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:49.421922 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-453ca9a8-7bcf-4c73-96f0-25665e455ef4 req-2ee85b89-3d4d-49db-9060-d0aa6f1bd6ea service nova] Creating event network-vif-unplugged:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 16:00:49.427227 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-453ca9a8-7bcf-4c73-96f0-25665e455ef4 req-2ee85b89-3d4d-49db-9060-d0aa6f1bd6ea service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053429 Dec 02 16:00:49.427863 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 567/1194] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:49 2020] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 16:00:50.111458 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:50.112220 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:50.120785 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:50.121278 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:50.122136 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:50.122634 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:50.901610 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:50.910840 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-0e03cfa1-a07c-4252-95ff-51e94c7732ef tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1457 microversion: 2.1 time: 0.809513 Dec 02 16:00:50.911450 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 628/1195] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:50 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1457 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 02 16:00:51.941163 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:51.944484 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:51.958128 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:51.959352 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:51.960428 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:51.961053 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:52.128115 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [req-0f341d9d-fc08-49ca-8e6e-4f73040f56d8 req-e1e45b81-1160-463c-a4c1-0ecbf532564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88e84b35-1972-4148-a6f7-a4753c5c6f2d", "name": "network-vif-deleted", "tag": "4e88c508-63bd-4782-ab84-478ed9ae3bb4"}]} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 02 16:00:52.144612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1046: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 02 16:00:52.144612 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: warnings.warn(msg) Dec 02 16:00:52.161861 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-0f341d9d-fc08-49ca-8e6e-4f73040f56d8 req-e1e45b81-1160-463c-a4c1-0ecbf532564d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:52.162593 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [req-0f341d9d-fc08-49ca-8e6e-4f73040f56d8 req-e1e45b81-1160-463c-a4c1-0ecbf532564d service nova] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:52.187065 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.compute.server_external_events [req-0f341d9d-fc08-49ca-8e6e-4f73040f56d8 req-e1e45b81-1160-463c-a4c1-0ecbf532564d service nova] Creating event network-vif-deleted:4e88c508-63bd-4782-ab84-478ed9ae3bb4 for instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d on hv-cinder-73761 Dec 02 16:00:52.196347 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [req-0f341d9d-fc08-49ca-8e6e-4f73040f56d8 req-e1e45b81-1160-463c-a4c1-0ecbf532564d service nova] 10.222.0.101 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091722 Dec 02 16:00:52.196948 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94391) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:52.198725 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 629/1196] 10.222.0.101 () {64 vars in 1313 bytes} [Wed Dec 2 16:00:52 2020] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 02 16:00:52.206254 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-9a7bd4e9-eb26-4080-826d-9dd0185cd0a4 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1385 microversion: 2.1 time: 0.280116 Dec 02 16:00:52.206880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 568/1197] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:51 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1385 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:53.232429 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:53.233253 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94390) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:53.241977 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:53.243051 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:53.243944 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:53.244480 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:53.329475 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:53.329983 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94390) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:53.330504 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.objects.instance [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lazy-loading 'fault' on Instance uuid 88e84b35-1972-4148-a6f7-a4753c5c6f2d {{(pid=94390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Dec 02 16:00:53.480710 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.policy [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd648b93a99946a88826d00930fb2726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92c709d41db94ec88054f3a048762c37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94390) authorize /opt/stack/nova/nova/policy.py:225}} Dec 02 16:00:53.490064 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-eaa265ca-681d-4560-ae00-7cbb3f564488 tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 200 len: 1227 microversion: 2.1 time: 0.268587 Dec 02 16:00:53.490677 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 630/1198] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:53 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 1227 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 02 16:00:54.516095 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:54.516706 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.compute.api [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] [instance: 88e84b35-1972-4148-a6f7-a4753c5c6f2d] Fetching instance by UUID {{(pid=94391) get /opt/stack/nova/nova/compute/api.py:2788}} Dec 02 16:00:54.525582 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:54.526094 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:54.526951 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Dec 02 16:00:54.527454 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG oslo_concurrency.lockutils [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Lock "82295c62-8f78-451c-abd1-d999b48833ae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=94391) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Dec 02 16:00:54.583887 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.wsgi [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] HTTP exception thrown: Instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d could not be found. Dec 02 16:00:54.584595 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Returning 404 to user: Instance 88e84b35-1972-4148-a6f7-a4753c5c6f2d could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Dec 02 16:00:54.585515 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-fd6dbdc0-ef21-448c-b480-171b216ec6dc tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d" status: 404 len: 111 microversion: 2.1 time: 0.079917 Dec 02 16:00:54.586390 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 569/1199] 10.222.0.101 () {58 vars in 1231 bytes} [Wed Dec 2 16:00:54 2020] GET /compute/v2.1/servers/88e84b35-1972-4148-a6f7-a4753c5c6f2d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 02 16:00:54.601075 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-77cb6bc8-fbc6-4558-8db2-0d5f578e7fad tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '.version_select at 0x7f02707c7158>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:54.936151 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-77cb6bc8-fbc6-4558-8db2-0d5f578e7fad tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "DELETE /compute/v2.1/os-security-groups/45066472-c9db-4980-92e6-7d11978b20f4" status: 202 len: 0 microversion: 2.1 time: 0.344379 Dec 02 16:00:54.936811 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94390|app: 0|req: 631/1200] 10.222.0.101 () {58 vars in 1267 bytes} [Wed Dec 2 16:00:54 2020] DELETE /compute/v2.1/os-security-groups/45066472-c9db-4980-92e6-7d11978b20f4 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:00:54.953190 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: DEBUG nova.api.openstack.wsgi [None req-5b3e7b1f-85ed-45b2-93c7-d3ce9dfd286a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] Calling method '.version_select at 0x7f027534fa60>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:514}} Dec 02 16:00:55.060997 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO nova.api.openstack.requestlog [None req-5b3e7b1f-85ed-45b2-93c7-d3ce9dfd286a tempest-TestShelveInstance-818439461 tempest-TestShelveInstance-818439461] 10.222.0.101 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-903078200" status: 202 len: 0 microversion: 2.1 time: 0.118776 Dec 02 16:00:55.061669 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: [pid: 94391|app: 0|req: 570/1201] 10.222.0.101 () {58 vars in 1246 bytes} [Wed Dec 2 16:00:54 2020] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-903078200 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 02 16:01:31.762806 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:01:31.763459 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:01:31 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:01:56.771957 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:01:56.772619 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:01:56 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:03:37.977750 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:03:37.978404 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:03:37 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:03:42.611872 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:03:42.612464 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:03:42 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:03:42.698730 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:03:42.698971 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:03:42 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:03:44.536700 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:03:44.537256 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:03:44 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:04:51.780284 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:04:51.780880 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:04:51 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 02 16:05:16.790228 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 02 16:05:16.790817 dv-cinder-737618-2-iscsi devstack@n-api.service[94389]: Wed Dec 2 16:05:16 2020 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!